ED OtS 161 24 SP 001 397 

A STUDY OF THE LOGIC OF TEACHING. A REPORT ON THE FIRST PHASE 
OF A FIVE-YEAR RESEARCH PROJECT— THE LOGICAL STRUCTURE OF 
TEACHING AND THE DEVELOPMENT OF CRITICAL THINKING. 

BY- SMITH I B. OTHANEL 

ILLINOIS UNIV., URBANAf BUR. OF EDUC. RESEARCH 

REPORT NUMBER CRP-2SS-7257 

EDRS PRICE MF-S0.50 HC-$4.92 121P. 

DESCRIPTORS- CLASSIFICATION, CLASSROOM COMMUNICATION, 
INTERACTION, *LOGlC, PHONOTAFE RECORDINGS, RELIABILITY, 
SECONDARY SCHOOL TEACHERS, ♦SECONDARY SCHOOLS, TABLES (DATA), 
♦TAXONOMY, ♦TEACHING, ♦VERBAL COMMUI41CATION, 

THIS IS THE FIRST PHASE OF A 5-YEAR INVESTIGATION INTO 
THE LOGIC OF TEACHING THE SECONDARY SCHOOL. DUE TO THE 
UNSTRUCTURED NATURE OF CLASSROOM DISCOURSE, THIS STAGE OF THE 
INVESTIGATION IS CLASSIFICATORY AND DESCRIPTIVE. TOPICS 
COVERED INCLUDE (1) SCHOOLS, TEACHERS, AND RECORDINGS 
(SCHOOLS INVOLVED, SELECTION OF SUBJECT AREAS, ESTABLISHING 
RAPPORT WITH TEACHERS, RECORDS AND TRANSCRIPTIONS OF 
BACKGROUND MATERIAL) , (2) THE UNIT OF CLASSROOM DISCOURSE, 

(3) CRITERIA FOR IDENTIFYING UNITS OF CLASSROOM DISCOURSE, 

(4) CLASSIFICATION OF EPISODES (ENTRIES AS THE BASE OF 
CLASSIFICATION, DEVELOPMENT OF CATEGORIES, KINDS OF ENTRIES, 
NOTES ON LOGIC OF CATEGORIES), (5) CRITERIA FOR CLASSIFYING 
ENTRIES, AND (6) ANALYSIS. (AF) 



c. 



Project Ho. 258 (T25T) 



01397 




A 8Btm or THB UX3ZC OF SBACHHIS 



A Bcport on tbe First Pbsse of a Flve>Year Research Project 



!Die IiOKical Stractuxe of leaching and the Develoj^nt of Critical nnhklng 

mtmmmmm r'^iwwiKii ii i__ ■ iirrn^-r -i-t~ mmmmmmmmrnmSm ■,■■■* W’ mmmmm mmmm 



Tae research r^orted herein vas perfomed 
pm*suant to a contract with the United Sl;ates Office of Siucation^ 
Department of Healthy Bdacation^ and Welfare.* 



Oolleije of Bducatlon 
Bureau of JSiacation&l Research 
University of Illinois 
Urbat^a. Illinois 



PrOijeot StsSS 



xareetor: B* Otlianel a&ith 



Beeearch Associates: Haiaey Jiene Aschner, 19 !^**X 9 ^ 

mton Heux, 19^x9^ 



Besearch Assistants: Geoe A^, X9^~29^ 

Katherine IfcKhi^t Agre, X 9 !Tr«X 9 ^ 
Janes Bowen, 19^X939 
Biwercl SeUy, I95r»X9^ 



Project Bb, 258 (7257) 



msFAsom mm 

3!hl8 is a T^ort on the first phase of a five-year investigation into 

the logic teac hin g la the seccntdary school* She tiro years of work cohered 

by this report have been m a r k e d by trial and error, advances and retreats^ 

h^^ipy thoughts that led down blind alleys^ and a few moves that proved 

]^roialBing. There have been no beaten paths to foUov^ no neat research 

designs to adopt* For the raw data of classrooB discourse are too varied^ 

too overwhelming in their conplexlty, and too massive to cast into the veil 

worn research models or the hoppers of statistics* Th^ mist first be 

Iblassified^ analyzed^ and refined. Our search for the logical 8truetox« of 

tteaching has thfirefore taken the form of a study in natural history. It 

is elassifieatory and naively descriptive. But ve believe that this is a 

stage of investigation that must be worked throng before we can understand 

teaching in its own ri^tj rather than as a system ot principles and practices 

si^pposedly derived from philosophy and psychology* The work described in 

this report is neither as rigorovuB nor as complete as we would have wished 

it to be. We are makin g it public at this stage of its development to fulfill 

our contractual obligations^ and to fasten the work down while we seek to refine 
it and to move osi into the next pliase* 

We wish to thank the schools and teachers who cooperated with us 
in this venture, and to eag^ress our gratitude to Professor Philip Zawrence, 
University of Canterbury, Christchurch, Hew Zealand, \dio worked with us 
the first year and helped us over mai^ a difficult point.. 
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In this report ve deal vith the ixiitlal phase of a study of the logic 
of teaching^ or perhiq^s it vould be better to say the logioo«>psyehology of 
teaching* !foachiiig has a logical dimensioii in idiatever degree It involves 
questions of truth value*<K>f whether statements are true or valid or 

invalid^ etc* It has a logieo^psychologicBl dimension to the extent that 
teachlng-leasming operations have a structure capable of foxioallsatlon by 
the procedures and techniqties of logic* 

1* logic^ ?sycholosy# ISeaching 

Xt is now widely held in pedagogical circles that teaching can ultimately 
be eag^lained and controlled by psychological knowledge alpne^ and that logic 
is irrelevant to teaching* Xn the nineteenth century^ before psychology he- 
came a science^ and before the rise of the scientific study of education^ no 
ouch view of the relation of logic to teaching was held* On the oonbxacy^ it 
was thought that logic described the mental processes involved In both IsBming 
and. teaching* Ib Bedawno, as well as to other Heo-HexbartianS| Bacon, mUj 
Jevons, Ifiach, and in ancient times Aristotle, had formulated in their logics 
the intellectual methods that led to efficient thought and dependsible con- 
clusions* Xt followed, according to their view, that if the teadber mastered 
the principles of both deductive and inductive logics he would then be Kble to 
eaplcy these effective methods as he instructs* 

fbls view of the relation between logic and teaching was ot^nsistent with 
the belief of both logicians and. psychologists as to the relation between 
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logic pi^cbology* Zo^c isas si^^sed tx> deal vitb the lAvs of the actual 
processes of thou^tj as \>rell as vlth the somatic laws of the mind* !£he laws 
of logic were the laws of thought. Bre-scientlfic psychology^ coordixiate with 
this view, assumed that the laws of logic were Is^llcitly preseat in the 
operations of the xolxid. lioglc aaad psychology were thus both in age^^ement as 
to the role of logic in dealing with mental processes. Esnee a theory of 
teaching based upon logic Incorporated also -idiat were held to be sound 
principles of psychology. 

M ^irical methods of psychological study developed;^ the notion that 
logic dealt with actual mental processes came to be seen as gratxiltoas* Bbr 
bhe things it became evident that ordiziary verbal bdiayior bore little simi«)» 
larity to the fdiraai logical strastures were the i^.nstay of loglcfans* 

Sbr another things actual mental processes^ wha’f;ever they might be^ were 
iinobsiervable* Hence the q]uestion of \diether they coordinate with logical 
forms, riaitfdned at best an qpen Question. 

It was not surprising therefore, that the young science of psychology 
sw^t away the vbole argument as to the relation of logic to tiental processesii 
At the very outset ^ eng^irieal psydbology reduced men^l processes to sensa*> 
tions^ ismges, associative mechanisms ex^ the like. Fran these psyehie 
el^nts it was no longer possible to construct a set; of principles similar 

to those found in logic. !Chen, as erperlmentaX animea psycdiology r^laced 
introspection^ consideration of loglc^ factors of intelligence were again 

swept aside along with the whole domain of cognition. In his epocshwiKihiag 
studies of animl inteUlgettce; *Ehozndike eliminated possibility of con^ 
sidering logical elements by reducing thixiklng and leamlng to a stimulus*- 
vei^ponse model. A response became connected to a stimulus by repeated temporal 
association of the two throu^ trial and error, reinforced by success# inking 
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tas thus Induced to a series of stloxulus«27e8[ponse actions occurring in accord- 
ance with the laws of readiness, eacercise, and effect* i\nd logic, as the 
science of thinking, was thus conjpletejLy undercut* 

At the same time that ^Qiomdike and others were advancing esiperisiental 
psychology, Dewey was reconstructing logic* Working in the context of ^ 
Darwinian iDodel-*envlronmental change, organic variation, selection, aM 
surwivaX.— Dewey fonnulated the pattern of inqjuiry ^^drlch incorporated hoth 
inductive and deductive logic as well as psychological facts* Instead of 
stimulus, he Qpoke of perplexing situation; instead of learned behavior, 

Dewey talked of resolved situation brou^t ^tnsut aetli^ in accordance 
with an appropriate hypothesis* Between the perplexing situation and Its 
resolution, Dewey put reflective tl»u^* Shoimdike, on the other hand, 
filled the 0^ between stimulus and response with neinroh connections* 

Badical behaviorism excluded even the neurons and thereby eliiaixHted the 
entire organiem as a factor in behavior, reducing psycdiology to the study 
of objective cozidttioas under which stimulus and response become cussoclated* 
ta Dewey’s view, logic is grounded In inquiry* Ttie rules of successful 
inquiry are the rules of logic* AsO. successlhl inquiry is inqjiiry which 
resolves perplexing situations* 3he rules of inquiry are derived by ftttftTy rf n g 
\d)at is done as perplexing situations are worked out* When fbmulated, these 
rules are the norms by which to assess future InqpirleSii ©ley may be dls^ 
engaged from inquiry and studied in and of themselves, as in fbxmal logic* 

!£hus formalized, they are apt to lose their connection with inquiry 
consequence, their nomative role in refleetive behavior* dHaaehing, in accord 
with this view, consists in guiding the lesmer tbrouidi^ the process of dis- 
covery and verification* 



Vratk l>eviey^o therry of logics^ educatloml psyo3)ologlsts drived the 
theory of problem solvliig, and Jaipatadck his project loethol of teachlog# 
loth Upatrlck and the psychologists Igrosred the normative a^cts of Bevey*s 
logical thacry aiid as^haslzed Its philological elcaaents^ ^ tSieory of 
motivation^ as iiell as the theory of learning vhich came to play a dondnant 
role in educational thought^ centered in this psychologized version of PeHey’s 
theory of logic* Its central idea is that the individual is moved to act iidien 
he is in an unsettled situatloiv>«one for idiich he has . no readynoade response* 
In 6u<^ a situation^ the individual is moved to try various veys of acting 
to overcome the barrier to his reaching a goal* i^orldLng himself out of 
such ..circumstances^ he learns* Bence we find today an eiophasls upon teaching 
by the problem method^ by the method of discovery^ and. the like* In this 
peda#!>#cal version of inquiry^ there is no distlnctidin between valid and 
invaHd thinking^ for such distinction caxmot be made vititdn a psycdaologlcal 
analysis of problem solving* 

now to the question of teaching^ ve begin vith the observation 
that .whether dr not logic is related, to teaching is an empirical matter* It 
cannot be answeznd on a priori grounds* pleaching is a natural social 

phenomenon, related to the cultural survival of a people, as reproduction is 

\ ‘ 

related to their biological survival* Shaching has its own form, its own 

\ 

constituent elem^ts, its own problems, and its own i^gularities* It takes 
place tind^ a stable set of conditional-time limits, authority figures, 
limited ability of learners, institutioi:^ structures, etc* /ill these con- 
siderations siipport the conclusion that teaching is to be studied in Its own 
right, if ve would understand it and thereby gain grj^.ter control over it* 
fhe foregoing conclusion is a pCint so obvious t3mt it might go vdthout 
saying, were it not for the fhcdi l^bat teaching Imis seldcm been studied as a 



pbesKuaenozi on its ovin terms* Xostead^ theories Sboat hov ta&dilsg is to he 
done have been derived from philosophical az2d psychological ideas and imposed 
vholesale upon the processes aiii structures of teaching* 

It is too early in the game of pedagoglcel research to say uith certainty 
vhether or not a vorhable theory of teaching can be derived from a theory of 
learning* But from a speculative standpoint^ it would s^^pear that efforts 
in this direction are ^t to ab(^* Steadying is one thing and i<^r - nfn e ia 
quite another* iind^it would seem^ the ^ between the two cannot be bridged 
by deductions txm lavs of learning* ifiat has just be^ said is not to be 
understood as suggesting that l^ieorles of learning have no relevance idatever 
to teaching* Bather^ the point is that the q^uestion of how and at idiat points 
in tl^ act of teaching psychological loaovledge is relevant would seem to wait 
for an answ^ upon the esiploxation of teaching as an -independent phenomenon* 

\llaen we better undex'stand what teaching is^ we can more wisely decide what 
Is usefhl to it* 

What has just been said about psychology applies with eqiuBl force to 

i 

philoBcsphy and to that branch of philosophy with which we are hm coacemed^ 
namelyj logic* Bevey and Kilpatrick^ in their separate ways^ no less than 
BeCarmo and others^ iaposed upon teaching their xesp^ive models«oBewey^ the 
xaodel of inq^iiiyj Kilpatrick^ a p^cdi o l p giged versioni.of the pattern of inquizyj 
and DeGanno, the deductive logic of Aristotle and the inductive logle of mil* 
Bevey*s conception of teaching and learning was grounded in his theory of logic* 
Xt did not reparesent a new i^roach to the problem of developing the strategies 
and tactics of teaching* Por what he tried to do was to move from the stronghold 
of hi s new logic into the dassrocm* Shis is precisely what jj^rUoscipbers 
tried to do throuf^bout the history of education* Bewey^s i^roaeh differed 
frsa those cf the post only in the fact that a different interpri^tion of logic 
was to be applied to teaching* 
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As in tlie case of psychology, an answer to the question of vb&t elements of 
logic are related to tes.cMng d^ezids i^n a study of teachiisg Itself* When the 
operations of teaching have been identified, classified, and analyzed, it my 
then be possible to tell how, if at all, logic is Involved in teaching* 

2* Logical Equivalence of Instructional S^XbJects 
It is frequently held in educational theory that subject© of instruction 
do not differ in their logical demnds, or else, if they do differ, the differ^* 
ence is inconsequential with respect to its effect the development of 
critical thiz&ing abilities* 9Ms view is reflected in the widely l^eld belief 
that methods of instruction determine the Mnd and rigor of intellectual habits 
that i«be student acquires* And it is further held that the problem-solving 
method of teaching suad leaamlng is supericnr to all othar methods with respect 
to the develcpQient of the ability to think critically, as veil as in other 
regards* ^Zhat is to say, idle abilii^' to analyze an argzment and to detect 
fallacies in reasoning, the ability to examine &q»erimental evidence and to 
decide whether or not an enplricaX investigation has been properly conducted, 
or the ability to note valuations and to analyze and criticize tleir justi- 
fications— that all of these can be as well tau£^ and lea rned in gacmetry 
as in Engli sh, in history as in physics* Either the subjects of instruction 
have no built-in logic, or such logic as they do eoibmce is the same from 
subject to subject* Thus the develagpment of critical tMnigjwg abilities 
all depends, according to this view, iq^n 'idiethe:.^ or not the teacher uses 
the method of problem-solving and delibemteay takes advantage of the 
opportunities to develop these abilities as they arise in the course of 
instruction* 
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!Ihe Idea of logical equivalence of bhe subjects is in a sense a corollary 
of the notion that Dewey's pattern of inquiry adequately covers all refiecuive 
thinking, itor the pattern of inquiry is si^posed to include all the logical 
operations that the establishment of knowledge In any field requires. Since 
the pattern, on this view, is applicable to all dcaaalns of e^qoerlence, and to 
all probleois, it foUovs that it applies . alike to all subjects of instruction. 
Of course, it can be maintained that the pattern as a form ax^lies alike to all 
areas of estperience, but that the detail operations within the formal model 
itself may vary from problm to problem and field to field* !Shus the logical 
operations by which an hypothesis is tested In a physics course znight not be 
precisely the same as those used in testing a proposition occurring In a 
history course. . It €qq}ears that Dewey held some such view, since he did not 
consider all subjects as being logically equivalent. But this intezpretatlon 
of Dewey^s model of thinking has not been put forth in pedagogioEd. discussion. 
On the contrary, his pattern of reflective activity has been interpreted in 
such a vay as to reduce all subjects of instruction to the same order and level 
of logical rigor. 

In a receipt investlgation*Ho find out whether or not instruction in the 
logic of certain content subJects—Soglish, science, geon^tzy, and social 
studieS'^would lead to improvement in the ability to think critically, we made 
the assu&ption of logical equivalence. 3But we were forced by the results of 
otxt study to question this assumption. In this investigation, teachers were 
found to vary widely with respect to results obtained by them, even when they 
teach the same principles of logical thinking under cotsparable circumstances* 
For exanple, two teachers, one in history and the other in physics, teaching 

•^ yie geaehlntt pt (hdtlcal thinking, by B* Othanel Snith, Kbxmeth B* Henderson, 
e^‘ al. (!Cb be published). 
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cojapaxoible grot^is of students and d*^ling with the same principles of loglc^ 
were found to ^t quite different results with respect to iisprovement in. 
critical thinking as measured hy the ACE test of critic®! thinking. *Ehe 
results obtained Ijy one teacher trere negative; by the other^ positive* 

^ Ijypothesls a number of variables may be associated with the differences 
in Insults obtained ly teai^hers^ as these are nseasured by student performance 
on tests* Asong these ‘variables^ ^notional (Climate and the sociaaetric 
structure of the classroom gsoup mi^t be considered* But our ©f 

the teaching situations led us to donbt that these factors were the significant 
ones. XntelUg^ice was held constant by statistical techniques in the analysis 
of the data, and is consequently not believed to l)e a factor in accounting 
for differences in results* These differences may be due to variations in 
motivation. But our acquaintance xiith the students and teachers led us to 
question this possibility* %breover, this factor would seem to oaiicel out 
partly because of the number of students and teachers involved in the Kn- 
vestigttion, and partly because of the fact that severe courses used in the 
project were electlYe«*in idilch it is sr^pposed that students enroll because 
of theii* interest in them* 

&} facts of that ittvestigatioa point to a totally different ea^lanation 
of why some teachers ai*e more successful than others in developing the critical 
thinking abillt5.es of students* Uhese facts point to the posslbillly that 
differences among teachers are due either to the differing degrees of rigor 
by which they carry on procedures which call into operation the higher mental 
processes, or else, to differences in logical operations built into the 
various Objects of instruction, or to both of these. Aaong these procedures 
are such typical classrooin activities as defining, eaqploining, proving. 
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jusitifyicg^ and the like. fSiese ere logics in cbsxaxxter, in the sense that 
ve judge how well such procedures are carried on by reference to the rules of 
logic, semantics, and scientific method* 

o o o o o o 
conflicting views with respect to the role of logic in teaching are 
considered, and when the farther fhct is held In mind t^t we do not know why 
some teachers succeed in developing critical thinking axid others fall to do so, 
it is dear that we need more intimate knowledge of the acttial operations of 
teaching thEui we now possess* In general terms^ therefore, the questions we 
seek to answi^ by the present investigation are: JRlarst. what loeiGd patterns, 
if any, axe to be found in the verbal behavior of teachers and studentst Second, 
are differences in teachers, as to the aaount and direction of dange in the 
logical thiz&ing of their students, related to differences in the logicE^. 
patterns these teachers employ^ 

Hhe purpose of the present pl^e of our reseaxoh is to esplore the logic 
of t^ching as exhibited in dassrooa discourse* llore sipecifically, we pro« 
pose to break such discourse into pedagoglcally significant imits, and to 
classify them into logicd categories* In the next phase of our work, we plan 
to instruct selected teeders in how to handle these logical structures 
(assuming there are sud structures in teaching), and to loeasure the effects 
of such instruction ipon dbassroom teaching and upon the critical thi.nk1.ng of 
students, as measured by appropriate tests* 
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tfo stuay tea(^ng txooi the standpoiot of its loglcBl structure it is 
necessary to have at one*s cognanfl a ftiLl record of the didactic disecnirse 
of the classroooie^ ve secured siudi a record hy tape recordings of ciassrocEi 
discourse laade tnsder as naraal conditiohs as possible* In this chapter, ve 
describe hov these recordings veve made and the schools in- \ihich they 'vere 
sfide* ^ also ix!dioate the subjects and grade levels covered by the 
recordings* 



1* Sbe Schools 

Because of the time and cost entailed in asking anid transcribing tepe 
recordings, ve vere able to record the- discourse of only seventeen class* 
roomsj. re^KTesentlng ^ve schools in different ccaosunities* Xhese schools 
vere selected in two Two of the schools had recently pasrtldpated in 

a project on the i£p 3 x>vement of critical thinking conducted tmder the auspices 
of the XUinols Curriculum Program* V7e were able to enlist their assistance 
in this project* The cooperation of the remaining three schools was secured.^ 
in accordaxKse with University policy, throu^ the OSfice of the Coordinator 
of Public School and University Arsiculatlon« This Office made contact with 
certain schools by letter and telephone. The letter described the project*s 
purpose and then went on to give specific details as folicjws: 
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1« Each teacher shouM be selected from one of the four subject fields 
of English^ I&thesaatles^ Science, and Social Studies* 

2* You 'Hould be ashed to select the teachers on the basis of your own 
judgnent of their coo^tenee as teachesrs* ^feaCher participation in 
tMB project vould be voluntaxy* of course* Shree put of the four 
teachers you select should be, in your Jud^seot, teachers of hlg^ 
ability*«in other vords, irm eamg the best tea^iers on your staff* 
The fourth teacher selected should be one of average competence in 
your Jud^nt* If you object to selecting an average teacher, the 
fourth teacher also nay be one of Mgh abUil^* 

3* Beechers vhose classes are to be taped -^.1 be given the foUoidcg 
facts about the recordings: 

(a) She teacher*8 vork is merely to be observed and described* 96 
evaluation idatsoever is to be lisede of any teaeh^*8 teaching 
or of the conduct of Ms or her classroGm activities* 2bis is 
a fact to be sbressed^ since soae of the teachers nic^ wxch 
under t^lng conditions with sdf ••consciousness and tensions 
idiich bnotfledge of tMs fhct vould dispel* 

(b) (Seachers, classes, and schools vill resaaln anonymous on the 
te^s and on the verhatin txaaserlptlons of these tc^s,. being 
identified thereon only by code letters and. nmsb^^* Only 
project staff members may li^n to theTO ts^es. . 

(c) Indi v M u al teachers, schools, end cooperating offiMals will 
be officiaily and gratefully credited for their part in this 
research on the final retort of tMs project vdsen it is pub* 
Xished. 

(d) 9b record a class session requires two individuals to 
equipment and to record the oea-verbal contest w f the pro- 
ceedings* TSie project staff has found that the presence of 
these indi*r IdualB (graduate students on the project staff) has 
created no discernible disturbance or disn^tlon of classroom 
ru^tlvlty* .After the first day, their presence was generally 
taken for granted and the ooxmal ataospheire of the class 
reasserted itself* 

9he letter then asks each superintendent for a different coobination of good 
and average teachers of the various subject areas and grade levelSf. 



Vq sou^t schools located in different sorts of conmunlties^ thou^ ve 
did not include Ckioaciusities in vMch the av<srage espenditure p^ P^pil was 
in the lover third of the schools of XLlicola* 5Sie five public high schools 
finally selected differed significantly in a nunber of ways. 
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School A is located in a suhwxh i^cb iini}ll recent years was congposed 
almost exclusively at lyusindss snd profeesiozi&X IntereBts* Hovever^ the 
last fev yeers have seen an jLucsreaslng ^saaS^T ot ^rklzsg class peciple laovixig 
into 1^ larger and older houses ^hlch are heing coxnrarted into s&ilti<»faally 
dwellings* She schoed. district includes a f&v light li^ustrles« She tom 
has alout 6^,000 inhabitants* !SBible 2:1 shows that tMs s^ 200 l eiqpends were 
per pi^il than 97 per cent of the piibUe sdiools of HUsols* 

School B is located in a siiburbaa^ re^dsntial^ rqpidly ei^oesaing 
coiaauni^ with a mlddle*class poopulation in 1957 of about 60^000* It has 
a few light industries and is the natiqiiaX headgUAftex^ of a large insurance 
conpuiy* Aa shown in ^Csble 2:1 below^ this connunity spent an ahove^verege 
amount of laoney per pi^il: four hundred sixty-six dollsrs per 

daily attendance* 2 his is hij^uaf thou 83 per cent of the public Me ^ 
schools of Illinois* 

^ district of scdiool C Includes a laa^ Mr RWeee Base id:ieh has 
several training courses for xn^ntmance and plane crews* dhe toun^s popu« 
lation is estlmted at about 25^000* Armed Sbrees families account fbr 
about half of the sedmol population* TSbere are no iadustrles in the town* 
school district includes scMe farm area* Its hig^ school eiiqpeQditure 
per pupil was about average for the State of Illinois* 

School D is located in a rural town of 7,000* There are only one or 
two very snail xaEuaufSacturing plants in toiwn* The school district covers 
a considerable rural area axxd the ptpils are about equally divided between 
town and country* Its school expenditure per pupil was a li.ttle less tJan 
average for the l^t'e of Illinois* 

School B is in an industrial and eoal^^Qinlng cily idiicdi has about 
ij0,000 people* The school is^ as in the other four oattea^ the only pilblle 
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&cbool In the school distirict* Its esepesditure per child vslb slightly 
less than average fbr the State of Illinois. 



^hle 2:1» Average dally attendance and espenditure 



School 


Average Daily 


Expenditure per 




iU^endan<^ 


average 

daily a44eManee> 


A 


tfitsf 




B 


sSok 


$k66»oo 


0 


l^53 


fe54*oo 


D 


550 


$307*00 


E 


1737 


$302«OO 



Percentile Bank 
( Eipei>ii:iatte' 
in 

attendance 




97 

63 



50^H^ 

kB 



* The latest figures available. 

** These figures are estimates and are >?ithin ^ per cent of the tsorrect zaaMsgo 



9s sun these schools have a vide range of eoBWunily hacl^roQiids* One 
school is in a middla-class suhizrh; another school is attended largely by 
professional-class children* A third is located in an industrial toun. Of 
the tvo schools idiich ore in rural c^cimuhities one has a large transient 
population. Two schools vere significantly better supported financially Hbosx 
the other three: 97 and 83 percentiles against 50 , 48 asid 48 percentiles. In 
fact^ the a nn ual cost per pupil in School A vas over twice as inuch as that of 
either School B or E« 



2. Selection of Subject Areas 

The question of the subjects in which to 3^ord class discussion^ ar>^ at 
vhat grade levelSjr was answered in part Idiie purpose of our study and 5Ln 
part by what was available to us in the schools assisting us. Since we were 
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sttsaylng tb& Jbgle ot teadblng, it ias to be eai^pected tbat those «ft>jacts 
tihich es^pbOrSlse diSsctic discourse eod Qooce;pt adbleveueut iraiuld be saost 
appropriate* 'SIbis criterion rujM out isutbjecbs placing priasry eqpbasls 
^pOu t3^ OwT s lglils uUCu oS. tflOse ibund ia p^Tsioax 

eduoatiouje and the lihe* m addition;^ we were interested in compering the 
Xogle of teacddng etaong the ccmvaxtloi»a content subjects such as hlstozy 
and acienee* fids led us to elimtaate those subjects sonetiues referred to 
as vocational ineh as agriculture and hcfie eoonanics* She availability of 
cubjeista luad teachers also arestrlcted oin^ choices* Ibr exwqple^ it was 
necesiAzy in one school to tape a physiology instead of a biology dess* 
had to ooit the tiding of tesiOi grade Shglish altogether because the scheduled 
teacher vished to drop out 'idieii the procedures of recording vere described* 

She subject fields fi na l l y chosen for arecordings were natheoatics^ 

soieneejt and social studies including history* 

Since the logical ogperations involve in teaching may 'vaxy^ either in 
foxm or detail, fran one grade to another, it seeoted desirable to distribute 
the recordings by grades as well as by subjects* we tharefore decided to 
record the subjects for each of the four high school grades* She only 
exceptions v^re eleventh and tvelftih grade xnatheBaatics* dbese wasre 
because of the difficulty of recording the l^pe of syoboUc operations 
usually found in these courses* Our subseqtient eiqperlence with the inters 
pretation of recordizigs In ninth gatiide algebra justified this dedslott* As 
shown in 2:2, seventeen different teachers were recorded* All together 
we taped five consecutive class periods per teacher or a total of 8^ cleuis 
sessions* 
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liable 2:2t 
grade 


Suasnary of subjects 
levels recorded. 


and 








10th 

grade 


Uth 

grade 


12th 

SraSe 


Totals 


English 


1 




1 


1 


3 


Mathematics 


a* 


1 






3 


Science 


X** 


1 


2 


1 


5 


filstozy- 

Social Studies*** 1 


1 


2 


2 


6 


Totals 


5 


3 


5 


4 


17 


*fhe tapes for these classes could not be used because the amount 
rendered them unintelligible. 


of seat work' 



tc^s for tlais class vere inaudible* 

^HMtincludiiag a class in sociology and one in a Core Pro g r sm * 

^ question of bov much of a teacher's classroom discourse to record^ and 
whether to concentrate the recozding in a brief period of time or to distribute 
it over a zoonth^ semester^ or year, is one which we considered at sotae length* 

It could be argued that spot recordings over a soaester or year would be mors 
representative of a teacher's work than an equal number of recordings taken 
consecutively. It would appear that spot recordings would, tend to cancel out 
the effects of variations of content within a course and of changes in style of 
teaching fctmi one topic to another. These are very cogent reasons. Nhverthe** 

less, we decided to mke five consecutive recordings per teacher* For one thing, 
such recordings would provide continuity in the teaching of a topic over a 

period of days* In this way, ve voulS, obtain the sort of context useful in a 
logical analysis. I Or another thing, consecutive recording is easier to 
schedule and less disruptive of school routine. OSiese are major considerations 
when the cooperation of a public school is being sought. Moreover, consecutive 




rocordlng Is Xqss cost*ly la 'tlioe ood noni^^ ^BpGcl&Uy tjhc schooXo««^8 
la the (»se of two with which we worked— ere a consldejrahle distance away# 

3* Establishing Bappprt with !lteaeh 3 r 8 

jhe teachers whose classes were to be reeoopded were selected, as we have 
already isdicated, by the sti^eriatendent or principal or both. Of course, 
this was not the ease for the two schools which had been connected with the 
prevlotxs study of instruction in critlcj^ thinking. Jn these schools, the 
teachers were selected by the curriculum coordinator id consultation with 
a project staff member. 

The validity of a recording depends t^n the confidence of the teacher 
in those who make the recording and ipoa his understanding of the pun>ose6 
and procedures of the taping. Ibr this reason a meeting was asrranged with 
the teachers selected in each school. The purposes and procedures of the 
project were thoroughly explained. \fe assured the teachers that the project 
was for scientific purposes only, that all tapes were to be treated anonymously, 
and that in no event would the dassroom work of a teacher be evaluated. 
Sbrthesnoore, we stressed the itaportance of each teacher foUovlng his normal, 
way of doing things during the recordings. We also endeavored to mftk e clear 
to the teachers, as well as to the superintendent and principal, that no one 
should volunteer if being recorded would engender anxiety or otherwise bring 
about personal dlseonfort '(dilXe teaching. Three teachers in two different 
schools decided oot to proceed with the taping, although they been 
selected by their administrators. 

To further increase the chances of having dassroom teaching as near 
noxmal as possible, we told the interested teachers that we wanted no more 
class pz'spazation than they would ordinarily make, that they gbouM ‘fe fa cb the 
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normal coirbent In their accustomed isouner^ and in gevueveJL to do whatever they 
noiraally do in the dassroom. 

As a further step to prevent modlficatloa of regular classroom procedures^ 
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pupils are usually ill-prepared for serious classroom worh when a major athletic 
event is imminent Is universally recognized* AIso^ ve chose weeks which were 
not too near either end of the marking period* We did this to avoid class 
sessions which were merely introductory or which contained reviewing for 
major tests* 

Another precaution was to have the teachers inform their classes during 
the week preceding the recordings that the cla^s was to be recosrded^ explaining 
why the recordings were to be made* 3b further insure minionm disturbance 
we requested that the classrooms remain unaltered physically in any my. 

Finally^ when we arrived to take the recordings^ ve set up our equipment 
as qiiickly and as unobtrusively as possible* Our tapes did not have to be 
changed or stepped during class time* in most classes we were seated before 
the pupils got there. 



Making a Becord of Background Material 
Still another problem was to secure a record of as es possible of 
what occurs in the classrocm. l?E 5 )e recordixsgs can reproduce only the sounds 
of the classroom* But often a facial esipression^ a gesture^ pointing or 
noddiiig is essential to understanding the speaker exactly. We had no facilities 
for making a record of facial expressions and nods* However, we were able to 
make a record of gestures and pointings in seme cases. In addition, a record 
ms made of the physical contents and arrs'^g*^ int of the caassroom, the size 
of the class, the materials used, etc. F* Jly, we found it advisable note 
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tile causes of eKtm«ve?bal eouzids such es footsteps and naohines* All of these 
things were noted so that we might refer to these sources while making subse- 
quent analyses of the dassroom discourse* 

record these SDu-siural aspects a ii^iuber of the project staff ims 
seated in the back of the room with the Taachine operator* observer 

secured the bibXicgraphic data on all books used in elassj the assignments 
given, and all inaterials used by students in preparing their reports as veil 
as all dittoed znaterial used In dassroom discussion* She observer also xoade 
a record of blbliograpbic infoxmatlon on pictures used in class and on all 
audio-visual xaaterlals* Bravlngs were made of laborato:^ eg^ulpment used in 
experiments or demonstrations, and calculations and drawings made on the black- 
board were also reproduced* Whenever possible, the observer noted the referent 
when anyone i>olnted to something in class discussion and did net name it, using 
instead the expressions "this", "that", "these", "those", "they”, "it", etc* 

!Ehe seating arraxigement and the position of other items in the classroom vei^ 
noted^ ani; so far as possible the f^st names of the students and their 
positions in the room were listed in case future analyses were to find such 
factors to be important* 

5* tlB3d.ng the Hecordings and tShnnserlptlcms 
The recording equipioent consisted of a tope recorder running at 3*?‘3/^ feet 
per second with a 7-iuch reel of tape* We had a volume unit (W") met^ installed 
in place of the "recording level eye" in order to better control the lover 
volumes. A pair of headphones was also used for a direct aural check of the 
recording while it was being made.^ Three semi-directional sderophoaes were 
used, each with its own adjtistable stand* A felt pad to lessen the piSkup of 
jarring noises was placed under each microphone stand* The three microphones 
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fed into a mlcrcjplione mixer vbich ]iEid individual volxuae controls and two 
aaiplification stages. ®iis device enabled the person recording to turn on 
only the microphone closest to the person speatetag. 0!his did mch to increase 

ux uae iroxce ay aecreasing nachground noise «l 

It was thought before the recordings vere made that it would be sufficient 
for the purposes of anaiysis merely to listen to the recordings as they were 
played hack* Bit it imsediately became obvious that an adegjuate ccsprei^nslon 
of the toglcal structure of the discussion could not be secured this way. 
PUrfcher, it vas found that discussion of the details of the t^ed discourse 
was nearly impossible -vben only the tape itself and the observer's records 
were available for reference, itod, in addition, it was found that coopre- 
hendlng the voices and what they were saying through a rather steady veil of 
noise caused by such things as chalk hitting the blackboard, persona walking, 
and the normal snovement and whisperings of students was not achieved exc^t 
throu^ a great deal of conceutmtion. 2his made it very difficult to think 
constructively about what was being said. 

It thus was necessary to tiaascrlbe the tapes onto p€Q?er. Our technique 
was wO listen and listen again, end to cciy down accurately i^diat we heard. 

Some words and phrases would be unintelligible to the transcriber. In such 
cases, he or she would try to n^e a guess at what was being said and would 
put the guess in brackets. 

®ie transcriber's rou^ draft was gone over by a staff member idso was 
actually present in the classroom at the time the recording was made. This 
individual audited the tape recordings, checking for accuracy »»d amissions, 
and trying to iuprove on or confinB the transcriber's guess in cases of 
borderline intelligibility. Be also siqplied the referents, whenever i>ossibXe, 
for e5q>re8si0E3 referring to the blackboard, to demonstration materials, and 
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the Xlke^ eod referred the reader to the ajpproprlate place In the ohsearver’s 
records tdiere diagrams, charts, etc*, vere reproduced. In cases vhere the 
student or teacher quoted anything, the auditor -would dteeh the source end 
get the exact page number fbr the benefit of the analyirt idio sd^t later need 
these things* 

!Ehe cciQpleted transcriptions uere put on ditto stencils* Anonymity was 
maintained with a coding system* 

A nunlber of conventions had to be devised fbr writing down the voices 
and sounds on -the -tapes* Bashes were used Instead of commas wherever 'tiie 
speaker's pause or hesitation or vo5.ce tone did not conform to the punctuated, 
form* ^e length of longer pauses -was indicated in brackets* \&ere intonations 
or gestures carried the loeaning, this was also indicated in brackets* Voice 
stress was indicated by underlining* If there was doubt about vheA the word 
or -words were, they would be put in brackets and prefaced with a qjuestlon mark, 
e.g. ”[? cerebellum]*** 

She flow of discussion -was divided on the page into utterances which 
-were -t^ed as paragraphs and nusfbered for convenient reference* (lS|y an 
utterance we mean the record of -the verbal b^vior of one individual, 
one point or another. In a verbal exchange -with one or more individuals*) 

^ breaking up the pages of -transcripts in this way we faciUta-te our later 
analyses. teachers* utterances we3re labeled -with **f • 'Wherever possible 
the pupils* irttezances were identified by first names; otherwise the ^mbols 
B (boy) and G (girl) were used. 




Projact No. 2^8 (72^7) 



CHAPTER III 

ws min oi»' CUU3R00M oiaccmiss 

It seeinad fairly clear to us that for the pvii'poses of our project some 
kind of unit would have to be developed to serve as a means of breaking up 
and analyzing the mass and variety of verbal behavior contained in the transcilpts 
of the discourse in classroom sessions. 

In: this chapter we shall first discuss briefly the requirements for such 
a unit. We shall then consider the basic patterns of the two standard forms 
of the unit we finally developed: the episode and the monologue.^ The episode 
is a multi-speaker unit; it consists in the one or several exchanges which 
comprise a completed verbal transaction between two or more speakers. The 
monologue, a single-speaker unit, marks the "solo performance" of an individual 
addressing the group. 



1. The Kind of Unit Needed 

For the purposes of our project, the unit of classroom discourse would 
have to be something more than a means merely of chopping up a mass of da ta--say 
a twenty-page transcript cf a forty-minute class sessioh--into small bits^ 

Such a unit would have to satisfy a number of requirements: it must have a 
low inference level, be logically analyzable, neutral with respect to subject 



^For a more extensive treatment of this aspect of the work see M. J, Aschner, 

g^ssroom Discourse s A Method and Its Uses (Unpublished 
doctoral study. University of Illinois7 19^9), IH7 
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matter content, and fairly reliable. These requirements may be stated more 
fully as follows. 

First of all, in order to ensure a low inference level, the unit had 

to ho a RTlT»n1«a hohaTr?nT*al r\nex '?l->o+ •» 

— 1 — AAAww juv --xMxj uwiii^A U.OC juuoiilo wx x'c;aUXX^ 

observable behavior, behavior that can be described in simple, concrete tenriSj 
it must focus clearly upon what teachers and students do and say in their 
sessions of instruction, recitation, and discussion. 

Secondly, these items of behavior must be analyzable in terms both of 
the logical aspects of teaching operations, and of the thinking reflected 



in the classroom performances of the students. In other words, the unit must 
enable us to examine those particular behaviors whidi it would be most relevant 
to analyze in our study of the logical dimensions of teaching. 



Neutrality was still another requirement placed upon our unit of analysis, 
s neutral unit is meant one that would take on the same general shape or 
”forro** regardless of its ”content**o A unit marked out in a geometry class 
transcript should resemble a unit found in an English transcript. Episodes 
occurring in science class sessions should be no different in basic fort from 
episodes in social studies class sessions. This generality of form is precisely 
the way in which a unit of classroom discourse must be neutral; for it thus 
provides the common basis, continuous from class-to -class, subject field to 
subject field, upon ?ihich comparisons can be made. Such a unit is capable 
of examination from any number of standpoints, and it is thus classifiable, 
as a unit, into any variety of categories. Upon this basis, comparative, 
quantitative and qualitative analyses can be made. 

A final requirement set for our unit was that of reliability^ That is, 
it had to be a kind of unit which, ideally, would permit any analyst trained 
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to use our instrument to identifir the same units in a given set of data that 
any other analyst, equally trained and using our instrument, would find 
independently in the same set of dats<» How well our unit meets this requiremei^fc 

will bft -fn -hVii* f*nnnw1ncr 

2* The tTnit of Discourse 

This section contains a description of two basic forms of the unit: the 
episode and the monologue* An episode, it will be recalled, is defined as 
the one or several exchanges which comprise a completed verbal transaction 
between two or more speakers* The monologue, on the other hand, consists in 
the ’*so3.o” performance of a speaker addressing the group* Two basic patterns— 
and a mixture of these— are distinguished and examples of each of these are 
given. 

lilpisodic discourse . In its normal course, a discussion in progress 
exhibits a characteristic movement. We often hear it described in metaphor 
as «ebb and flow**, “give and take”, "talking back and forth”, etc. Even if 
we cannot understand the language bvaing spoken, we can note this almost 
rlqrthndc cadence of speech and silence«—»or rise, forward surge, and subsidence* 
Over and over again, certain regular sequence? of verbal inteiTplay occur, 
falling into endlessly repeated patterns of action and responding action* 

We can sense a forward surge in the flow of talk, propelled by the familiar 
rising tones of a question or declaration. A spate of responding talk is 
thus launched, runs on, then tapers off. We can hear the ebb and drop in 
voice tones that presage a pause. We can note the familiar sound and gestures 
that seem to stem the flow of discussion with ^ find, comment, or with the 
conventional nod of acknowledgment. Sometimes a brief silence intervenes, 



but just as often, another voice rises in further question cr assertion^ and 
again a stream of talk flows among the speakers, until once more it subsides 
or is cut off by the word or gesture that signals a closingo In this repeated 
rising surge, flow and momentary drop in the tides of conversation, episodes 
are formed, one following upon anobhero 

The boundaries between episodes, in the series constituting a discussion, 
are traced in part by noting a number of conventionalized forms of speech 
and gesture which typify group verbal behavior. Certain standard forms of 
utterance are used, for example, to enjoin or invite iirjmediate replyi other 
forms are conventionally understood to forestall or prohibit jlmmediate response. 
A direct question, addressed either to a given person or to the group at 
large, conventionally demands some kind of responding action on the part of 
the individual or group addressed. A rhetorical question, on the other hand, 
is commonly understood to be uttered for its dramatic or rhetorical effect, 
e.g* during a monologue; although some do serve to trigger off discussion, 
reply is neither expected nor invited. Tilhen a reply is made to a direct 
question, it is also a convention that the reply itself be acknowledged in 
some way, at least by word or gesture if not by further responding commentary 
or questioning. These and other standardized and conventional forms of verbal 
behavior fall together into definite patterns in the course of a discussion. 

We have encountered two basic patterns of verbal exchange in classroom 
discourse. The first basic pattern of exchange is called the r; — B^rocating 
pattern . Here there is alternation between two speakers, of r. ^al sally 
aid response, of the regular bade and forth movement so aptr y described as 
reciprocating action. The other basic pattern, called the coordinate pattern , 
is one in which each successive speaker responds more or less directly to 
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the entiy rather than to the remarks of the immediately preceding speaker; 
hence each remark following the entry Is coordinate with all the others, 
with respect to that entry and to the remark closing the episode^ 

The following series cf three episodes, reproduced from or*e of our classroom 
transcripts, illustrates the reciprocating pattern®^ (In this excerpt, a 
broken line underscores in each episode the remark which serves to launch 
the verbal transaction embodied in the episode » V/e call remarks which function 
in this way entries <, Paired diagonal lines have been placed as indicators 
for the breaking points between episodes*) 

Teacher: Now who- »»» do you know who was the first person who- -uh-» 

§Iicoverpd the Hawaiian Islands? Steve? 

Steve: Was it Captain Gcok? 

Teacher: That *3 ri^t*// Do you know abait what time it was* Steve? 

Steve: Uh--sixt8en seventy— something? 

Teacher: No, it*s not that early* Come down about a hundred years* 

Steve: 1770? 

Teacher; les* It was 1778, actually during the time of our American 

Hevolution.// And do you know what he called the islands? 

They weren^t Hawaii at the time* Arybcdy know? Oh, I think 
this is an easy name to remember r«especially around uoon* 

Steve? 

Steve: Cook Islands? 

Teacher: No. They weren’t Cook Islands* [loud laughter fwm class] 

That’s a good guess, but that doesn’t happen to be it* The 
Sandwich Islands* 

Steves Oh* [more laughter] 

Teadier: Do you eat sandwiches at noon, too?// Dn— ih*-this particular 

period, the United States wasn’t toe interested* Of course 

^Taken from a United States History class, grade 11.^ Transcript C-21 

pp* 1-2* 



we were concerned with gaivdng onr freedom from— uh— England 
at that particular time, but soon after that«...^. etc. 

In hor second utterance above-) the teacher confirms Steve *s reply to 
her original question and then proceeds to a^ him a ne^f question. Her confirming 
”That*s right” closes the first episode j her new question is the entry wliich 
opens the second episode* This series doses with tha teachsr»s humorous 
play on words, after which she launches into a lectiare-type monologue. 

It should be noted that the same two speakers carried on the three 
transactions illustrated above. Episodes ai^ determined not by shifts in 
speakers bit by shifts in what the speakers are tallcing about aid by the 
speech forms and patterns of their daa liz^s with the point under discussion. 

In the first episode, the point of concern was the identity of the discoTreror 
of the Hawaiian Islands. The second episode focused upon a different point: 
the date of the discovery. !‘Ihea this question was settled, the teacher and 
Steve moved on, in the third episode, to the point concerning the name first 
given tlie Hawaiian Islands. In each case, their dealings with the current 
point went through a three-phase pattern? The point was raised in a question 
(opening phase); a reply was ventured and judged (sustaining phase); the 
exchanges were then either sustained further or dropped by the teacher* s 
conventional affinviing (closing) remark. Episodes vary in maiy ways from 
me simple archetype illustrated in the first of the three episodes above. 
Nevertheless, each episode stands as a discrete unit, as a completed verbal 
transaction. 

Below is a typical example of an episode, corresponding to the coordinate 
pattern. TliS point under discussion in this instance concerns the question 



of a novelist* s use of his stoi*y as a medium for propaganda 



Iteacher! 



• •»// A3J. right I now^ as Carol pointed out^ i\lan Paton is 
pi®9ding for l^e altematxve solution'»**T'hat of brotherly 
love or peaceful co«-existence between the races. Now, wl^at 

Z2H ££■ 8 novelist who tries to preach a lessoiTor"* 

to*»-uh-»promote his ooint of vi^ thT»nncr>» +.ha 
fiction ? " 

Ji^ause, one second] You think of that, [pause, two seconds] 



Marys 



Teachers 



Danny s 



Judys 



X was Just going to say that I think it^^s the type of the 
novel, I mean it»s the way that it is presented that moves 
us. He could present it in different ways if he wanted to. 
Not necessarity the [garbled two seconds] the novel or-^— 
uh— oh, something that teaches you a moral lesson. 

All right, just as we discussed, it»s a short story. Some 
stories do have a moral lesson to preach and then they 
become parables rather than Just generaHzed short starles. 
And others simply are entertaining, Danny? 

Well— uh«-I think that more people would be interested in 
the fiction fom of the novdL than*««uh— >in Just a pamphlet 
giving specific reasons why the two races should live 
together in brotherhood, I think it would attract more 
attention and be more interesting. 

Well, since it*s-«*When people read it, it*s more parallel 
to everyday life. Oh— you might bo able to understand it 
a lot better in a novel and so on. Otherwise you Just see 
these facts and you wculdn*t associate yourself and how you 
would feel and react to it. 



Teacher? All rights //Well,r-ncw, the chief funcUon of any kind of 
fiction is to entertain, isn’t it? 

do you feel ^at in this book, Ciy the Beloved Country, 
the author is actually entei^aicing you ? Barbara? 

The entry which triggers off the episode reproduced above ia the teacher’s 



entry question: “Now, what do you think of a novelisti^,,,etc,“ Maiy responds 



and the teacher acknowledges, "All right", adding a supplementary couwentc. 



Then Danny and Judy each respond to the point, on© after the other® The 



^FTom an En^iah class, grade 11, transcript R*l5 fiX, p. 2, 



teacher acknowledges their reinar?fs >rithout comment, proceedirg; then with a 
more or less rhetorical device to preface the next entr/: her question about 
whether Alan Paton's novel entertains its readers o 

A third, fairly common episodi^j form is shaped by a mixing of the 
reciprocating and coordinate patterns. That is, both the coordinate and 
reciprocating patterns of verbal interplay occur within the same episodeo 
Below is an example of a mixed-pattern episode. The example is taken from 
the same English class wo hove obssrvsd c(pp2Xot9 Qlscnssion is ncij’ concerned 
with some of the central characters in Alan Patents Beloved Country . 

The teacher is referring b«low to one of them, John Kumalo, an ardent proponent 
of black supremacy in Africa, as she sayss^ 

Teadieri W^t is to particular talent that is being used in this 
organizati<m ? Mary? ^ ^ — 

Maryj His lion’s voice? 

Teacher: His lion’s voice? Was that it? 

Waiyls We31<*<^ had a real booming voice. 

Teacher: tJh»-Bill7 [adcnowledgoBa hand raised] 

Bill: He had his--*! was [garbled 2 seconds] I was thinking ebout 

vheu they— you know— get them all shook up or southing like 
that and then they— [A boy breaks in: "OhJ all shook 
upl” laughter from class] You know what I mean, well— you 
know' like— well, I don’t know how you explain to a— 

Teacher: I know what you mean, but I can’t say it. 

lydia: He had the pox-ier to agitate— to get people— to kind of— he 

appealed mostly to their emotions and he ’d get them so far, 
then he’d just sort of— just some way— decide to— that they’re 
hungry and some people would say [garbled 2-3 seconds] for 
food and he [one word lost] more and more and he got— putting 
Into propositions the [inaudible S'-l}. seconds] natural way 
[garble 2 seconds] keep them from doing it. 



^Prom transcript B-15 jftL, pp. lO-li. 
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Teacher: Uh—at one point5 isn*t his voice called "Old Grandage**-*- 



isn*t that one of the descriptions that Paten uses? And 
his partiailar talent of leadership of the group that he»s 



working witii-- 'uh— *is to oe a •"**uh«-«irrpassioned speaker—;^ ou 




can just picture him on a street corner getting everybody 
all riled upo//Uh~ »Vf'>.o else belonged to tliis leadership on 



it were to win^ were to lead to black supremacy ? 
Tcalls on boyj 



This mixed episode moves through several reciprocating exchanges between Maiy 
and the teacher* Then Bill and Jydia join in^ each responding to the entry 
rather than to what I%ry said* Hence Biliks and Juc^*s remarks coordinate 
id.th Nary’s with respect to the entry* The teacher closes off that point in 
the discussion with some elaborative comments and then launches a new episode 
with the entry question: "Who else belonged..,. etc*?" 

It should be noted, incidentally, that episodes are not always brought 
through a final or closing phase, as are these presented here to illustrate 
typical episode form. Quite regularly one episode will be teiirajiated without 
any explicitly closing comment or nod of assent | instead, the transaction 
is closed off tacitly by the advent of a new entry, that is, of a remark 
advancing some new point, which, in its oim tui^n, touches off a spate of 
responding talk. There is nothing out of the ordinary abcut a discussion 
which proceeds through such a series of "truncated" episoder They are 
merely one of the everyday phenomena of group verbal acti^diy. 

When these patterns of exchange break doi^n—fail to take coherent form 
on the “^rbal record— and when no single speaker is doing ail the tallcing-^it 
is likely that the discussion itself has become disorganized and confused® 

This happens occasionally, and is worth noting* An example of a class discussion 
gone temporarily off the track appears below® This is another junior class 
in Uiiited States History, organized on a student -chairman basis* teacher 
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speaks nominally from the sideline s© Judy is chairing the day’s proceeding;s. 
Just before this episode^ the teacher, x^o mo'^es in and out of the discussion 
at viOl, has closed off an episode by refe3?ring to Daniel Webster’s famous 
pleas for a firm Union in the ^'hbster-Ha^ne debate over whether an indiv5.dual 
state could rsjllifir an act of Congress or secede from the Union. The teacher 
then raises a new point with an entry question 



Teacher: 


It was one that you, as a schoolboy in the 1800’ s, would 
have memorized word for word, and probably gotten up and 
declaimed it: ”0ur nation indivisible" and so forth and 
so on.//Well. how did nu32ification fit into that? 


Judy: 


I*m still confused* 


Less 


7es| I am, too^ 


Teacher: 


What about Marcia, there? 


Jack: 


Wasn’t it one of the Southern states again? 


Teadier: 


Well, why don’t we turn bade to Marcia^ here? She knows, 
[laughter] 


Warcia : 


X don^t how^ow— 


Teacher: 


fes! [laughter] 


Marcia: 


Noi Jackson and Calhoun disagreed completely on this— and. 
I don’t know how it comes then— 


Teacher: 


You were talking about a speed: there nen you were telling 
us about it fiirst. Remember? 


Marcia ? 


Yes, 


Teacher: 


Somebo^r threatened nullification or somethii^ like that. 

Do you recall that you brought that— [rest of question blotted 
out by voices in background] 


Marcia : 


The debate from— [garble] 



Teacher: Tes « 






^From transcript A-10 ^3, ppo 11-12 
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^%rcia: South Carolina and Connecticut ••oh— the senators from South 

Carolina-'-uh— threatened to leave the Union, 

Teacher: If what? 

^-^arcia : What? 

Teacher: If what happened? 

%rcia: I don’t know. '^'?hat do you mean, what happened— during the 

debate? 

And so the confusion continues} Les, Jack^ and Judy each break in with scattered 
comments, quite oblique to the point. Finally, after about ttiree more minutes 
of chaos, the class settles down to orderly discussion, ^ tracii^ the patterns 
of exchange through this passage, the analyst is able to focus more sharply 
upon the progress (or lack of it) made in d-=aling with the original point 
raised by the teacher* Other forms of scattered discussion occur in which 
everybody talks at once and no one seems quite clearly to b<? speaking either 
to the point or to other speaker, 

Wonologue discourse . The second form in which our units of classroom 
discourse WSy t32 identified on the transcripts embodies the alternate basic 
element of group verbal behavior; the %olo performance” of a speaker addressing 
the group. For an example of how monologue discourse typically occurs during 
class sessions, let us return to the U, S. history class thsit we observed in 
a discussion of the Hawaiian Islands, The teacher has been talking with Steve, 
ut will be recalled. She turns from their play on words, signals (by the 
ubiquitous ”Uh— ”) that she intends to continue speaking, and launches into 
the following monologues^ 

Ttacher; Do you eat sandwiches at noon, too?//Uh—i:i this particular 
period, the United States wasn’t too Intercisted, Of course 
we were concerned with gaining our freedom from— uh*«-England 

^Transcript C-21 #1, p, 2, 
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Teachers 



at that parti alar time, but soon after that we began to 
send people out around the world to trade and, of course, 
to stop at one of— many of them would stop at the Hawaiian 
Islands o The first people who vjent out there to settle, 
however, were not traders o Do you knotr what their interest 
was? Do you remember what their interest was? They went 

^Y> +.ho one t rv -fVso 

in the islands® They were missionaries, and they were going 
out to try and christiani?ie the— heathens® Dien—uh— people, 
who were interested in— uh— trade and fanning in particular, 
went into the islands, and their concern, of course, was the 
raising of sugar cane® 

And that brings us down into the period of history that 
we have besi discussing more recently— when— uh— they were 
trying to make treaties which would make it possible for them 
to trade with the United States— particularly to get rid of 
their sugar in the United States® And the first trade treaty 
was made in the l870*So It was a reciprocal trade treaty 
in which one particular product from Hawaii Woo ^0 be admitted 
to the United States free. Uh— the product was, of course, 
the one whidi they had in greatest quantity at that tione— 
sugar® In 1880, they renewed that treaty, and the United 
States got the right to use a particular coaling base— 'Uh— 
coaling station thei«.//Now, ^ you have any idea which base 
we acquired in the 1880^8— the use of whidi base? One that 
you aSb^d recognize. A very prominent part in the Amertcan 
defense system today® Tory? 

Pearl Harbor? 

Pearl Harbor® That’s ^.dght® Ax 3 d«>uh— we have had a base there 
at Pearl Harbor, then, since i860® / /Now® how did the United 
S tates first become aware of the problem of.®,? etc* 



The excerpt above stands as almost a classic example of a teacher’s 



monologue discourse— in this case the didactic exposition of subject matter 
content® It is also quite typical of the way in which many teachers move 



from discussion to "lecture” and back to discussion again® Note how the 
word "Now" serves to signal the advent of something new, as this teacher 
shifts from lecture back to dlsjusslon with the entty question: "Now® do 
you have aiy idea whldi base *®* etc ®" And again, after her brief exchange 
with Tony, her "Now" signals a forward shift— this time into a new episode, 
with the antiy question: "Now® hew did the United States first ®. .. etc ®" 



o 



(Qy some kind of tacit convention, "Now”, typically voiced in rising 
tone and volume, has become a standard alerting device, serving to signal 
listeners that a shift of some sort is at hand. Teachers and public speakers 
use regularly, and in two vrsyst to shift, as above, from lecture to 

discussion, and, in the case of extended monologue discourse, to signal the 
approach of some new turn in the topical content of the speech. This little 
word "now" thus serves the analyst as one of the recurrent verbal cues he 
may use in identifsring breaking points between episodes, and between monologue 
units and the episodes adjacent to them on a transcript,) 

Wonologue discourse does not reveal asy great regularity of pattern or 
phase-like qualities, as in the c ase of episodic interplay* However, expository 
monologues in progress often exhibit a kind of paragraph-to-paragraph movement. 
This is seen in the teacher's monologue abcjve-s-indicated by an iident— .as she 
shifts from the topic of early settlers of the Hawaiian Islands to that of 
trade treaties between the Hawaiian Islands ard the United States. A solo 
speaker seems typically to move from point to point in his exposition, raising 
it, elaborating at some length, and then proceeding to some further point. 

It is useful in the analysis of dassroom discourse to take note of these 
paragraph— like passages in a didactic monologue for the relation their contents 
may have to prior and subsequent class discussion* 

Monologue discourse stands in sharp contrast to that carried on in tlie 
back-and*forth interplay of discussion or conversation. It is normally ea^ 
to distinguish a "solo performance" from that of the individual speaking— even 
at great length— in reply to a question asked him. This is so because both 
the occasion and the conduct of monologue discourse are more strictly and more 
explicitly delimited by convention than is the case with episodic discourse. 
Convention decirees not only how the Individual shall speak: he addresses his 



words to the group at large and not to any one ot few memb^-'S of the groupj 
it rules for the group as well: its nenibers are an audience— silent listeners. 
It is conrontionally understood that conversation^ exchange with the appointed 



speaker is neither eirronted vtr\y jt ^ 

— — . • Av dvivMooo iixjftj jLix one couin&ei^ 






of request and permission to speak, is normally perceived as an interruption, 
an intrusion. A. monologue perfoxmance, like that carried on in an episode, 
is thus shaped by convention to stand as a discrete whole, a completed verbal 
transaction— in this case one undertaken between a speaker and a group. It 
is a transaction in the sense that speaker and audience are come together 



for a common purpose^ that the group shall attend to what he says. 

Certain types of monologue activity are characteristic of classroom discourse. 
The most common of these, of course, is the didactic or expository discourse 
of the teacher. However, in his role as leader and arbiter of class proceedings, 
the teadier also delivers, upon occasion, announcements, assignments, dictation 
^terial, and sometimes admonishments and moral preachments. Student monologues 
generally consist in such things as the presentation of assigned reports, 
recitations of memorized material, oral reading from text or blackboards, and 



so on. 

Although there is variation among the classes taped on this project, 
monologues occur much less frequently than do episodes. This is to be expected, 
since monologue performances are quite normally reserved for special purposes 
and special occasions in group discussion proceedings. 
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C3AP!EER IV 

A 8ST OP CRX2I!S!IIA FCSl Um?S OP CLASSEOOi^ DISCOimSE 

Sie Bet criteria zised cfn l^s project foT breaMxig clc^srocsa: transcripts 

1 

doun isd*o tsilts of discourse ‘Hill be presented fPTd discussed* It consists^ 
as we have said^ la a set of descriptiTe statsassats about weibal behstrlors 
that can be observed daring class sessions. t^rpes of verbal actioix 
described are those which typically initiate^ sustain^ and close off the 
se^xeziees regularly observable in the classroom. !13iese units ccaprise the 
episodes and srmologQes described &s& iXl'ust 3 ^ted is preceding chutes* >* 

Hi order to sustain continuity wilb the material la the previ\?us 
we shall begin this chapter with the criteria thoiBelves. OSaea we give 
an account of the various avenues of ^proach we e^ored before arriving at 
the present set of criteria. Pinally^ we Bhaii describe the procedures 
followed in the testing of the criteria for reliability^ closing this vt^a^ter 
with a rerport on the results of these reliability tests. 

1. Sie Pom of the Present Set of Criteria 
Without further discussion, we present here the set of descriptive criteria 
which we developed for use in laarhing classroom transcripts off into series 
of units. 



For more extended discussim of this part of the vork see M. JT. Aschner, 
^e Analysis of C lassroosa Blscoui'se; A Method and Its Uses (uspublished 
doctoral study. University of Illinois, 1959 ), Chapter V. 
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MbXvsx& of Claesroom Blcreouree 

ClaesrocxQ dlecourse ssey be enal^d izito two IsindB of usdts; ^iaodesi 
and sioau>Iog;«ie8. 

A* bXseoarse: All of the verbal behavior occiirriog dsirlog a class period* 

B. UttezaELce; ^e coo^lete record of the verbal beh&vlor of ooe Indlvidiial 

cct ooe point or another within an episode* ErcXaisatlons sneh. 
as by the teacher^ \diere eoneuireat with the stndent^s 
vezbal b^vior^ do not count as utterances* 

C« ihi episode is a imlt of discourse involving a verbal exchEmge between 
at least two Individuals* Xt passes t^jipically through three phases: 

(a) an iiiltlal or opening ]shese^ (b) a sustained or ccixtinuing phase^ end 
(c) a tersdnaX or closing :^iase« 

e:l Bhe isiitial or opesilng phase of an episode always contains a vesBsck 
or set of remarks (assertitms, ^^tions» anaouneeiaents, etc*) idii<di 
is called an entry ^ 

c:ll Bemarks of other types ssey occur within the afpeoing phase* 

ihese iQsy function as introductory or prefatory to the entry* 

c:2 !I!he continuing phase of an ^isode ccastains remarks "laundied!' 
di r e c tly by the ^try^ or indlreetlyy by one or more reneoios 
which were directly launched ^ the entry. 

e:3 Bhe texmiaal or closing phase of an ^isode may contain remarks 
designed either to suppleaaent preceding remarks or to cut off 
the flow of discussion* Xn the absence of closing remarks^ the 
tenxdnus of an ^Isode is marked only by the advent of verbal 
laoves chax^teristic of opening :^:tase of a new episode* 

B* A SKKiol^i:^ is an extended unit of discourse spoken by an individual 
^ which does not esdilbit episodic form. In addition^ the monologue 
differs fztss episodes in idiat no other weaker is Involved in any sort 
of verbal eschange^ except by intrizsion or intem^tion* 

Criteria for Identifying iplsodes and Monologaes 

1* An entry consists a remaick or set remarks (^zestions^ esserttoos^ 
etc* s i g mdiatng ttat it will be followed by discussion^ and setting 
the direction of that discussion* 

1*1 !Ehe entry launches or advances tiie discussion in a new direction* 

An advance of discisssion in a new direction is xoazked by: 

1*11 A eooplete (dzange in the topic or subject of discussion. 
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1.12 iatyo&ictiao of a vi3w aspect or part of a tqpic, ei&jact, 

or argument of octe part vas treated in a prior episode. 

Thift ne» aspect may liave been sisntioned In the initial or 
ofpening phase of a prior episode^ but not be specifioally 
tc&en or derelopetd in that episode. 

1.121 Calling for further instances or cases of the topic 

or subject usider discussltmp exc^gt for sisple enumeration 
of instances, shall count as an entry. 

1.13 Hetuming to a point discussed In a prior episode and sub* 
se^pieatly dropped, but to vblch the epealser aowr enll.3te 
or en^oizKS fUrisher discussion, sh all c<amt as an entry. 



1.2 Xf a speaker advances a elalai or raises a ^sticsi or Issue not 
being ecQsidered, and if he does so issvltation, consist, or 
sisply on bi« ovn rather than on destand, his ressazk s h a ll coxsnt 
as an entry. 



1«3 If en en'toy atateoent Is repeated after one or laore episodes hsEve 
intervened since the ‘was first introduced, it gha l l count 
as an entry if it satisfies all other re^xlrezBents for an entry. 



A ronaxlc or set of reuaa^ is said to be an ahortire entry if it 
fails to elicit reuponse even it ssy satisfy all other 

entry xe^iirements. 



1*5 An entry does not engage the preceding speaker in clarifying or 
c< 9 Atintting xdxat he ^ust said. But it isay be addressed to the 
preceding speaker, either directly or by implication. 

1.6 to entry is not a statessent that has been re^^sired, enjoined, or 
souf^t for ly the preceding t^^eaker. 



2. Ihe contiiiaing phase of an ^isode is mde of resasxks uhicli are: 
(a) either replies or responses to ^^xestics^; (b) claisas, coonauts, 
or opinions; (c) ^^xestions vhlch sustain the entsy or point under 
discussion; and (d) anotoalofus ^^iestions. 



2*1 A r^ly is a verbal stove (remark) soade in answer to a question that 
was addressed to the individual giving the answer* 

2.2 A response is a verbal xnove (remark) made in answer to a question 
-that van addressed at large rather than to a particular individual. 

2«3 Cleiais, eosnasnts, or opinlosts addressed to the point rmder di8eussi<nii 
in the episode are neither replies nor responses. Olhey serve to 
sustain the flow of discussion. 

2v4 Questions serve to sustain the contltmlng phase of on episode if 
they either direct attention to a prior qixestlon, or if they take 
up the point of a prior reaoazk. 





2*kl Qxestioas vibiieth atteatioa Isack to a prior c^ixestlaa 

is the <^j>Qodes 

2.411 B^licaticnu ^i9e ^estions re(p&^t mtvy ^stics^ 
or saor ether ^isjsslsimf ia game warflg . !!Siey usoaliy 
occur tv"5ien the first renderiag of a ^^stlon vss act 
heard or att^ded to« 

2«412 Hejphrasix^s !Ehese 4^aticxQ8 poimt of 

^txy ^eaestioa^ or ^ say other in scsmfh&t 

tUfferent vord8« ’^Otese ^pzetstlcsas uauaUy oeetsr a 
qjoestioa vss not underetood or vhen the ansver to the 
original ^isatloei ¥as imsatisfaetoxy. 

S.413 Heshapisg: !Chese ^i^xeaticsas go beyond rephrasing 
in that the coateat of the original is 

sone&diat altered* ^Ihls alteration retnmB attention 
to the intentr&us^rt) of the original Qiestioa 
ty pointing cut an enp^S^ ia^died in originol 
fomulatlon but vhich s^gperently needed explicit rendering. 

2.42 Qaestions ' ^ich develop or elaborate tSie point of a 3^rior 

Ration or statement by: 

2.^21 A s h i n g for anplifleation, elariflcaticei^ inforoation, 
evidoice^ or justifieaticn of nhat a epeaher has said* 

2.422 Ashing or ca l. l , i ai g for personal opinion^ prefereaees^ 
or Judgments directly eoneemins the point being 
considered. QoeSx reqiiests aaoy be addressed either 
to an in d lv ldnal or to the group at large. 

2.43 Anomalous ^stiems: 

2*431 Shetorioal: ihcoe are assertions in qpestion form. 

!Shey are usually mode to invite agreement^ to give 
informatlan^ or to elicit supplementary cozmaents. 

2.432 Besignatlves iOjese are q^estioiss uhich have nothing 
to do with the content of discusslca but rather with 
the designati^ of vho should or may speak* An 
individual mey be designated^ or the ^stlon say be 
addressed at large* 

2.433 Ccaae-bock signal: Otis is a ^lestion or a statement 
vhlch has nothing to do vlth tiie content of discussion. 

It is used as a signal to the preceding speaker that 
his last remark vas unintelligible^ inaudible^ or 
otherwise in need of restatement. 

2.434 Review: ^ese are ^juestions which are asked to refresh 
one's memory about idiat was said earlier in the aP^sode 
or even in a preceding episode* 



3* Aa ^isode may pass tlirou^ on owertOy teimlnal ptoe or be eXoeed oft 

by the abnq^t change of topic or subject idsieh olgaals the opening of 
a new e^pisode. 

3«X 39ie overfcXy closing phase of an episode Inclxxdles r^nuaxfes which 
ser^e ea^ressly to cut off the flow of discuesian, catting 

off laay be effected by the xepetition of the last stat emgir fc of t^he 
contimiing phase, or by such eagpresslcn as "Alt right”* ”0.K.‘*. 



3*2 Ike close of an episode is often marised by the oceurr^ce of 
s^Bpleaeataiy or elaborate coosaents which serve to punctmte 
the current flow of discussion* 

3*3 la the absence of ronarfes eaqpressly cutting off discussion or 
of eiTOleasatary coBaaent^ episode is taken as temlaated by 
the oecsurrence of rsaaaiks yhloh signal the qpenlng of a new episode. 

^ ^soaologue, as a feature of classroom discourse, stands as a unit* 

4*1 It is inaiiced by the introduction of one or more new topics or 
subjects, or of one or more new a^cts of a topic or subject 
previously cautioned or discussed* 

1}..2 ffixe treatment of the materials intaroduced in soaolQgue discourse 
is carried on entirely by a single speaker, and. sustained by 
him without verbal eaihange with other speakers , except in We 
event of intrusions or Intem^tions* 

^*3 As a unit of dJ.scourse, a X2X3nologue satisfies neither the criteria 
supploaentary in the closing phase of an ^isode, nor of 
being prefatory in the opening phase; nor can It be counted as a 
feature of the continuing phase of an episode. 

WWW 

It Is doubtf^ whether "^ae instrument in the form reproducedabove. would 
seam useful to anyme lacking the conceptual and technical background \diich it 
presupposes on the part of the aiaalyst* However, it should be kept in laiM 
that this form is on© that was designed for use by a group of analysts who 
were already familier with' our conception of verbal behavior and alsready 
eacperienced in the study of classroom transcripts. By the tiiae we arrived 
at the present set of criteria, for those who took part in its development, 
a coBBcon coaceptiml and procedural franae of reference bad been attained. 
However, we felt that it was necessary to present here the set of criteria 
in the actual form in which it w€is tested and put to use* 
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Bobs features of the instrumeat in its present form should he noted. 

It begins wilOa a brief list of definitions. Then it presents four groups 
of criteida. £aeh gzoup is numbered^ and each criteri^^ has its own number 
vithin a group. All criteria of the number 1 group concem liie identification 
of entry moves in episodes. Criteria in groins 2 and 3 cover the kind of 
remarks found in the sustaining and terminating phases of episodes. 3be 
fourth group of criteria is used to identify monologues. 

In marking off a transcript^ the axialyst tags each utterance with one 
or more numbers from the set of criteria. This number represents his Judgment 
concerning the identity of the particular remark or yo rpa rks in the 
utterance . We have made it a matter of standard procedure. In the early 
applications of the instrument^ always to affix the criterion nuzobers to the 
utterances of any transcript. This practice not only facilitated testing, 
since disagreements Judgment were thus quickly located; it also provided 
each analyst with some msans to measure and maintain self "consistency in 
his own Judgments. 

It should be noted that we do not consider the present form of the 
instrument as final. Its formulation is still relatively crude at certain 
points, and could readily be refined and more succinctly worded. It is also 
likely that additions and revisions amy be made in the continued application 
of the criteria to transcribed discussions. However, it is not likely that 
any set of criteria could be developed which would account for any and every 
item of verbal behavior that my occur in discussion. For language is as 
infinitely varied in its foims as the human activity of which it is a part. 

2. The Development of the Present Set of Criteria 

As loi^t be expected, we vere obliged to explore more than one line of 
approach before we arrived at the point of view leading to the coastruction 
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of the present set of criteria* Ho^ever> es ve progressed frOTi stage to stage 
in our thinking about how to develop a useful and reliable unit of classroom 
discourse^ xsany of the insi^shts and ideas vhich ve rejected for ^e reason 
or another vere not discarded but set aside for later use. Antong these vas 
the notion of the "sketch", vhich we shall describe in a later section. 

As ve took the task of defveloping a unit of discourse, one of the 

first qjoestlons ve considered vas: Into vhat kinds of categories ve 

\ 

eventually want to classify the aifferent kinds of things that go on in 
discussion? Two general ct.:^gories vere suggested, one "cognitive”, the 
other "nan-cognitive” . Within the so-c^led cognitive category ve would 
classify such "logically structured" activities as: etatiiag hypotheses, 

defining terms, evaluating, giving evidence, justifying a claim cr an 
opinion, examining evidence, examining arguments, etc. In the "noa-cognitlve" 
category we mi^t classify such activities as: giving directions, praising 

or reproving, routine class business activities (taking attendance, dictating 
assignments, etc*), jokes and isa^elevaat anecdotes, and the like. 

After extended exploration of liiese and similar notions, we decided to 
set aside the ”non-cognitive" Question for the moment, and to see vhat results 
would come frcaa attenpting to classify the "cognitive" activities of a class 
discussion according to the following categories: Sxplauaticxi, Term-Referent 

(defining), Proc?f, Justification (valuation). Maneuvering (teacher strategy), 
and others. "Others" was the place for everything that failed to fall into 
the first five categories on the list. £aeh inember of the groip then made 
an independent analysis of the same transcript, astdd-ag his own copy with 
the symbols E, T-R, Pr, Val, Man, and 0 , Uj© results were chaotic j; t jreesosnt 
between me* 'e than two or three of the six analysts over the category of a 
given utterance appeared to be more a .mtter of coincidence than of 62^ comma 
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bests of judgment. Aad. yet by this tliae we were becoiaiGS more clearly aware 
that our problem was one of achieving reliability in independent judgments; 
i.e., of developing some set of criteria, and a procedure for applying them, 
by which an individual could analyze a class discussion, doing so in s-ieh a 
way that another person, using the same criteria and the same \ x^^^duie, would 
come with the same results. 

From this ea^rience we learned many things. We learned first that one 
must be 'purely descriptive’* in classlfirlng discussion activities. Thus 
we shed the stubborn preconception that an instance of verbal behavior can 
be classified in terms of the logical norms by which it is evalimted as logically 
sound, truthful, accurate, ccmcplete^. etc. Of course, definitions, proofs, 
and ea^laaations can be analysed for their logical structure, and s^raised for 
their logical soundness. But it seemed inappropriate for our paiposes to 
impose these f o:rmal conceptual schemata outzli^t upon the actiial activities 
pec^le carry on when they explain things, define terms, attempt to prove 
something. What does a person do when he explains? When did he begin, when 
did he stop, winrt did he do in the middle? These soce the hind of ^estions that 
confronted us on the transcripts at every turn. As our experience with actual 
discussion increased, the ^estlons multiplied. And, one by <me, our rather 
rigid and foxs^ preconceptions about '’cognitive b^avior’* began to fall away. 

At the sasse time, we began to recognize new dimensions in a persistent 
problem; How naich weig^it do we eceord to the literal "meaning ' or content of 
an utterance, and how xmch do we assign to its role as a verbal act in discussion 
(such as a clala, a reply, a c h allenge, a guess) in deciding how to classify 
it? Ts there a distinction to be di’awn between what someone says and what he 
does in saying it? Thus, for exesple, in saying *X aa going to town*, e person 



aay lie maldLng a threat as veil as stating his intentions. Whether he is 
znafeLng a threat or not depends i©oa the context, tone cdP voice, etc. When 
we es^lain somethlxig, vhat isakes it- an act o£ explaining'—the fact that we 
are saving reasons to support a conclusloji, or the particulas? set of words 
we say la giving reasons? Bo we count Idle act of reason-glvjjig as part of the 
eaqpl al . nin g, or do we consider only sone xelatlcm between the words stated in 
the reascm and the words of the conclusion being defended? In observing the 
w^ people actually do talh together, we began to see the :polntlessnes8 of 
distinguishing sharply between the act of answering a questian ”the 
answer” which its wording presuajab3y constituted. Yet at the sas&e time, 
we kept encountering ceuses in which failure to give joore wei^it to the verbal 
act or to the words of the act left us unable to decide whether or not a shift 
was taking place to another subject or point of discussion, or izterely in the 
. manner of treating the current one. 

The next step in developing the present set of criteria consisted in 
coloring the idea of the sketch. 03iis was suggested by Heopel’s development 
of the coaceptior f the "e^lenation sketch ’ in his analysis of historical 

n 2 

ei^l^iation. Heapel holds that historical esplanaticms of human events, as 
constructed by historians, lack the completeness and the ti^t logical structure 
which chai'acterize scientific explanations of physical phenonseija. But this 
lack is due, he says, to iac<mplete knowledge and to the iijpossibility of 
expernnenting with the past. Ohe'refore, historical explanations should not 
be expected to do more than sketch in the picture of past events and the 
here and there between them. 

%ee Carl G. Hejnpel’s article, "The Function of General Laws in History,” in. 

H. Feigl and W. Sellars, Editors, R eadi ngs in Philosq^cal Analysis, New 
York; Appleton-^Jeatuxy-Croffcs, Inc^i 19^9. 
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Txsjosla'tjUsg this notion over to the descriptioi of discourse seeioed to 
suggest a way to maife off isajor blocaa of discussion in tenns of the "logical 
structure " of tiie activity being carried on, whether or not tiiere would be any 
logical or foxing "caapleteness’* in the activity undertaken. Urns we could 
identify a series of utterances, perhsps covering two or three pages o;.' tt. 
transcript, as an e^qplanatlon sketch, or an evaluation Sketch, even thou^ 
no eoncluislon say have been actually stated, or even reached "implicitly" by 
the acknovled^ent and aec^taace of reasons or evidence given discussants. 

The result of this e^rr:ach to analysis was the outline r^rodneed below. 

It appears in the revised, but still tentative, fora which was constructed 
ePlKnit six weeks after an earlier version had been fozsulated worked over 
In successive staff neetings. 

Identification end inalysls of Sketches 
I. Sketches In Discourse 

1» A sketch is typically a part of a body of discourse. It nay consist 
of one or aany utterances depending on the logical nature of the 
utterance or utterances. 

2. The logical structure of the discourse within a sketch is constant. 

A c hang e of logical forss signifies the end of the sketch, {e.g., 
a change from defining to eaq^laining. ] 

3« The subject of the discourse within the sketch nay be any one of 
the folloving: material or social object, person, place, 
statooent, etc. 

II. Kinds of Sketches 

1. Tb^ following kinds of sketches are conjectured: explanation, 

evaluation, tem- referent, logical«proof, verification, Infoinatlon, 
direction;^ procedural. (It is anticipated that this list will be 
refined as discussiois are analyzed.) 




hill 

Varloos Kin^ ^ Sketches 

1. E^lasation sketch 

a) The subject is typically a statement or event. 

b) The sketch contains a gts^eral proposition (descriptive), 
assufied or stated, which is used as an es^lanatoxy role 
(principle, law, hypothesis) to account for the statecoent 
or event. 

c) ihe sketch contains evidential statements (the truth of \diich 
is usueilly’ taken for granted) which msy be used to connect 
the subject to the general proposition. 

2 * Svaluatlon sketch 

a) The subject is typically a person, event, act, social or 
aesthetic object, etc. 

b) Ihe sketch cantaiz^ at least one normtive principle, assmsd 
or stated, and faetiustX stateisents used as a reason for the 
rating givtsa. 

3. Term-referent sketch 

a) Kie subject is typically a verbal egression. 

b) ihe sketch contains statesaeats which tell what an esspressicn 
is used to refer to. 

4. Logical-proof sketch 

a) !E!he subject is a proposition. 

b) The sketch Indies descriptive statements used as prsaiises 
from whi<^ the proposition to be proved is derived. 

c) The sketch rarely presents a ccmplete argument. Sd^ of the 
premises are not stated. 

5 . Verification sketcdi 

a) The subject of th-5 sketch is an observation stat^cent which 
has reference to obse-vables. 

b) ae Btatament used as a subject Is typically derived frcaa 

otcer statements for i*ich it is taisen as ertdenoe vhen 
verified. 

e) Uie sJcetch iapically contains descriptions of vsriah.les— 
controlled and expeiimental. 
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6* Isfoxmticm slsetch 

a) subject of the ^cetch can be az^thlng whatever. 

b) The content of the sketch consists of the nasratlon of 
factual natesrial tihlch aioy serve the purpose of ori<^nting 
or "setting the stage" for discussion. 

7* Directive sketch 

a) !Qie sketch con^dns statements 'which result in guiding 
'the discussion toward, a desired goal. 

b) Direction may be in the form of cooiOBisds, frestions^ or 
suggestions. 

8. Procedural sketch 

a) The subject of the sketdh is the operation of classrooa 
routine. 

Rc3es for Identifjyiag and Azaalyzisg Ssetches 

1. Sketches in general 

a) The beginning of a ske'tdh can usually be identified by 
noticing certain language cues. For erasple^ term-referent 
sketches typically start 'vl'th a ^estion sudi as: How 

do you define " 

b) The language cue vhldb. introduces a new sketch is often a 
^stion which guides the discussion in such a 'way as 'to 
result in a logical structure different from that of the 
preceding 

c) Determine the logical character of the Sketch by using the 
descriptions given in Part IXX. 

2. i\nalyzl 23 g explanation and evaluati a sketches 

a) Identify the principles (descriptive or nonmtive) by the 
use of which the subject is either esp^ained or rated. 

These principles may not be eispllcitly stated. In -this 
caae^ foimuiate the principles from out of 'the content. 

b) Identify -the fac'^ual statements which are offered as reasons 
for the Giq^lanation or 'the rating given to the subject. 

e) Reconstruct 'the discourse in'to logical foim. 
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AEialyztag a texm«referent sketch 

a) Ideatify the cjg^sslcm or tern to be es^licated. 

b) Betezislne the type of definltloa deveXorped in the discourse, 
o) Reconstruct the discourse into definitional fom. 

(others to be developed) 

MmM 

In the veehs of voxk: and discossloa csi the sketch enalysis fom r^rodiieed 

above j several transeslpts were studied and narked off into sketches. As 

ueual^ we would select a transcript^ each staff member mxklng his own 

copy independently, ^en we coo^pared results • Some of these are worth noting. 

?or exas^le, it turned out fre^^tly that as many as five out of six analysts 

vou3.d etsree cm the houndarles-^the beginning and end-«of a sketch. But then 

they would disagree sharply on vttis.% kind of a sketcdi it would be. 

(he such occasion arose csver a sketch m8,xtced so that it began with the 

(^estion, did the Civil War not happen in 1829-30? 2?wo analysts 

decided^ on the basis of the fom we used^ that the discourse following this 

qDuestion was a directive sketch. !Ihey argued that the teacher was using 

thi3 question and en6^dng reamks to shape cmd direct the course of class 

discussion for that day. One peirson judged the sssss passage to be an infomation 

sketch. His reason: ihat this was an explanation sketch that never got goings 

hence the rejsssarks were snei^ly infoimtlve* Three other analysts clai^d it 
was an explanation sketch;^ but then disagreed ^nong themselves about what 

kind of explanation it represented. Xn sisaller cases there would be fairly 

hi^ agxeeasgnt— four to five out of sir— •among analysts as to the bosmdaries 




''^From transcidpt A-10:I, #3> P» 5* 



ii-Jlii- 

of a sketchy T^ut disagareeuient over whether it was a case of evaluation or 
e xpl a n a t lottj or some other 2dnd of sketch. 

However, these disagreeiaeats were far less significant than Utie incieasinc 
nuojber of agreements among v*s on mgaking off hodies of discourse. Tbi^ foXlcwing 
passage was narked off alike by all six analysts. Ve also agieed to ea i T It 
a texm-referent sket^. 

f: --<4Qiat is the dlfferoiee between nullification and secession? 

Ilhis is SQoething that we should have at least aSked^ too^ at 
the vexy beginning. 

Judy: fiullificatlaa means to reject against something? Well, let's-« 

T: Well, don*t look at me* fell the gro^p or get somsoiie else to. 

iJudy? I *m not sure ...Jack: 

ilack: Nullification is when a state disobeys the Si:^rGme Court but still 

remains part of the Ihiion. • . . 

f: Secession. 

Jack: Secession is leaving from the Union altogether* 

T: Yes. (A-10:I, #3, p. l6) 

The really interesting point here is that everyone ended . this "sketch” 
after the teacher*s "Yes", rather than after Jack's final remark on secession. 
I-Zhy include that last utterance? Weil,, caiae the several aaaswers, it seemed 
to Jack's definition, so it is part of the tena<>referejit activity. 

Also, said others, it served to close off the ^etch—in some way to punctuate 
it. seme passage was later marked as an episode. 

During our work on sketches, we came more and more to maak their beginnings 
and endings in terms of what we called language cues. As a matter of fact, 
our agreements were beginning to depend on these recurrent, conventionally 
patterned features of the di.scourse, while our disagreements continued with 
respect to its "cognitive" character* ^Qiis suggests that, whether or not we 



vere averts of ve vere already analyzing discussion into lanits on sane other 
basis than the one set forth In the fom used In tracing out different types 
of sketches. 

t bdaavioral ggpproaeh ^ analysis . At about the sone tlase ve 

vere getting under vay in the seasMh for sketches^ the ideas for a nev e^roseh 
to analysis vere presented to the group. Xt adg^t bc^ a good plan to analyze 
discussion froBi a linguistic stanc^^i^UDt# l.e.^ in tenss of its own xnovoaents 
and contours^ according to the natural units or segnents vhieh the observable 
ebb and fLov of its progress seeiBS to delineate. Xhis could be done vithout 
regard to the "cognitive ’ or "nai-cognltive" character of the activities taking 
place in discussion. Also^ sudh an idea had a certain plausibility^ since 
In a ae kd j ^^ off specifie bresks between passages on the transcripts^ ve 
been relying more and more upon language forum and patterns than imon the 
"loglcsil” eharacter of the discussion. 

Zn addition^ such units vould seem to be "neutral". 0!hey seemed 
to shipe in sisdlar patterns on every one of the transcripts. »Phifl vould 
give us a cosaaon basis for eooparing discussions fvoBL one class to aaotherr. 
Korec^e'r^ it seesmd likely that ve vould then be able to analyze these units 
from more than one standpoint. Wr could develop a great variety of categories^ 
each one vith its own set of criteriaj; then ve could classify these units end 
blocks of tmits ia vay for a paorticular purpose, and In other vays for 
different purposes. We could study a chain of these units front the standpoint 
of the teacher's pedagogical strategies, for exaaple. We could examine likewise 
the same units in terms of their "cognitive" type. We could classify them from 
yet another standpoint; according to how (questions at different levels of 
abstraction and coaplexily are responded to ly students; also vc could 
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eloseUTy them aceordisg to how teaicbo?s deal t?lth t!iese responses, ^us 
this e^roach sould seem to he siore versatile than cstbexs ve Ixad tried. 

Xt alght also give tis a eoaerete. obsexvable basis for a reliable set ^ 
descriptive criteria vhlch ve could use to imx^ off units on tbe trsnserlpt. 

A new outlooia on language vas thus proposed and e:^lored« Instead of 
consider5Jsg prlzaarlly the content and purport of vla&t teachers and students 
say^ ve began to looh at each reneuA: on a transcript as a verbal aorye» «»l.e.> 
as m aetion perfonaad in and throuj^ the use of language. She speslEer in 
discussion^ on this vies^ is an agent of a verbal action, such as a plagrer on 
a games field Is the agent of a play or series of plays as the gsi&e progresses. 
He may toss the *^hall", receive it, pass it, run vlth it, etc. In the hade 
and forth interplay of discussion, of course, the ”hall” Is the eurrent poSnt 
being dealt vlth among the spedeers. A ”play**»-'a verbal vme on the pert of 
a diseassant««!say thus be an entry ^sti<»i, a reply, an announcezaant, a closing 
remark, end so on, dspendlng upon hov the speaker is ourr^tly talcing part 
In discussion. 

Moreover, in this seam "games'* metaphor, a class discussion can be 
seen as an activity bounded by certain codes and ground'»niles of play. !2here 
are "rules" (conventions) for hov to ask a #iesticn, when to eak it, and even 
rules for vho nay ask vhat kinds of «*e8tions. Obsexvanee of these conventions 
of group discussion is not a matter of conscious conformance so much as it 
an hs*wiw*2s3= vay of bdiavlng, a pattern of behavior ae^psired primarily through 
experiaice and social induction. And it is in the speakers’ regular* perforiaRaea 
in accord vith these ground-rules of discussicn that the recurrent psttemas 

of verbal performance and interplay axe framed ieto the episodes and moncaogues 
ve have earlier described. 
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The ne^ s1*^ ahead laj*’ Ihl 1«he developse]Gi'& of & se1> of cri*te 3 dla a&d a 
piocedare forinsrJsSas the tz^ajacyipts* I£ aisch a eet of easlterla tuxaed out to 
te sufflcleu^Xy 3^Xi.ahXe fo 7 om* purposes theu T/e \~70uXd iiscrre at Xsst asrrXved 
at the Isind of unXt ve vere Xodking for, Ohat is^, Xt i?oaXd he a slag^Xe, 
"h^havioraX” unit, Identifiahle in ohseimtiou at a relativeXy low level of 
Inference^ it would he a versatile unit, pex^olttiag us to classify a given 
Tttiit into a variety of ca*tegorles, hence to view given instaacee of teacher^ 
student interaction from a masher of standpoints^ and it would be a neutzal 
unit— it would have general applicability to any transcribed class session, 
irrespective of subject field or grade level. 

t 

3« The Beliability of the <?rlteria 

The type of reliability estiroate we used to assess the dependability 
of our criteria was one m percentage of agreeasent between independent 
jud^nents* The esiperiiosntal phase of the deterisination of reliability involved 
obtaining independent jud^oents of ‘fche utter^ces on the transcripts* 

The statistical fonzszla we used was a siiBple one involving the percentage 
of agreeBjeuts out of the total nuafijer of units marked. 

We felt that it was very iiportant that a training procedure be followed 
with the judges to ac^maint th^u with the type of data being dealt with aTid 
especially to clarify the conceptual fr 8 iaBfwoii 5 within which the judgjaentB 
were to be asade. 

Four staff saembers of the project were used to obtain the iadepend^t 
judgments reared for the reliability test. iChese staff a^aibers had not 
participated in the deveiopmsat of the criteria. 

The Si^vfcerlal used to train the judges eon*',isted 3n actual transcripts 
of the class sessions. ?5se two used the zoost were the first transcripts 
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in borfcii the etoentli-graae TJ. S. History (A-IO) end eleventh-grade Kne liffh 

(B-I 5 ) series, i.e*, A-10, B-15> ifl* A-XO, ^ also was used to soaae 

extent. 
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narking the training transcripts Indlvidaally, and discussing difficulties 
with the staff nsaabers who had develorped the criteria. 

®ie mterial t»ed for the actual reliability eetisKtes consisted of 
the sefveu renaining transcripts in the A-10 and B-I 5 series, i,e., A-10, 

#3S A-W, fin A-10, Bi B- 15 , B- 15 , #3; B- 15 , and B-15, 

fhe first stefp of the final testing consisted in each of the four 
Judges iBBrhing off independently what he fudged to be the total set of 
units (both episodes and ocinologaes) on each transcript. He nusfibered 
each verbal move cs» the transcript with the nuntoer of the criterion he thou^t 
it satisfied. Ihe Ji^dges weare to distinguish the greatest nuiaber of units 
which could result from the use of the criteria. 

In the second step of the final testing, the four Judges worked in 
two teaaas of two Judges each. Within each team, the two Judges together 
considered each verbal zaove in the li^t of the criteria and their original 
asses^ients of each iBove* After this stepjr sssny disagreements were eXiiirinated> 
others persisted. 

^ese confined resiiXts frcm each pair were used for the reliability 
estimate^. (We felt that it was better to use the eosibined Jridgpisnt of a 
pair of Judges to estinmte the reliahility of the criteria because of the 
eoaipIC3dty of both the smterial in the transcripts and the criteria themselves. 
!I!hese factors tend to result in a nusd^er of "sheer oversl^ts" and accidental 
skips in using the criteria, and can be reduced significantly by using pairs 
of Judges to arrive at the units.) !£he fonsila we used for the reliability 
estixiiates Is: 
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vheve le the luxuiber of ag3*e‘ejaents between teaias X aad Y, Ite By) 

3,« the ^ mlnA • fr.'hgt t?E?0 * **-<^**”*« ^*- ftwri jt^g 2SJ!2bS2* Of 

episodes saax&ed tsy teem X> and By is the total nuniber of episodes ssaz&ed 
by team Y. 

reliability estlisates obtained are presented in Table 1. 

Table 4:1. RelieibiJi.ty estioAtes for the eriteri% 
based on selected tcpes from transcript 
series A'*10 .end B-l?. 

Series Saaiber Ts^ Buaiber Seltabillty Estimate 



A-10 


#3 


.71 


A-10 




.73 


A-10 




•62 


B-15 


#2 


.71 


B-li? 


|3 


.70 


B-15 


& 


.64 


B-15 


0 


.69 



The estimates razsge from .62 to »73-**a fairly small range-^vith. a 
median of . 70 . 

!!!he disagreements seem to stem mostly from the aniblgaity of the verbal 
jaoves. Becsoise of the many subtle shadings end nuances in behavior^ utterances 
are not clearly specififid>le as fitting one criterion or another. One particulfsr 
discrimination we have consistently had trouble with is in applying criteila 
1 2 and 2.421; where the judge ssist distiziguish between a netr aspect of the 
same topic and a clarification or aaplificatlon of setae point in the topic. 

We have been imable as yet to formulate a general and consistent rule to 
eliminate these difficulties. Another difficulty arises in distinguishing 
betf^reen long prefatory r^terial and monologues. 



Project Ho. 25S (?25T) 



V 



CUSSmCNSIOS OP episodss 

Episodes can be classified in a nuaiber of ways; by the nature of their 
content, by the nimiber of verbal interactions they involve, by the psychological 
processes they ^tail, and so on. !£he purpose of this study requires that 
episodes be classified in teians of their logical features. In order to classify 
episodes in this vjay ve nust do two things. Pirst, ve jaxst either Invent 
categories, or else, use those whidi axe found in the domain of logic. Second, 
*we most wo3:^ out criteria for deciding that a given episode belongs to a 
particiilar category. We shall treat the develqpnent of categories in IMs 
chapter, reserving the discussion of critearia for the next chapter. 

1. Entries as the Base of Classification 

It -tfill be recalled that <^isodes are aade up of three parts— an opening 
phase, a ccntizzuing phase, and a closing phase. As ve began the task of 
vorMsg out a classificatory scheias for episodes, the question arose as to 
•whether the entire episode or a particular part of it was to be considered. 

We could classify the opening phases and thereby groi^ ^isodes lay these 
phases. 5y the saise token re could use either the continuing phase or the 
closing phase as the classificatory base. Or again, we could classify the 
episodes as such without regard to their parts. 

Certain eonsidex-ations led us to classify eg^isodes by their opening 
phases, ihe opening phase always contains a verbal move which evokes at 
least one, but more often a series of related verbal exchanges. 5!hl8 verbal 

5^sl 
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ffiove is called an entity. Xt la always a self-iniljialiicg wove on the part 
of the person who inahies it and it Is followed "ly responding re!sar?cs. 35ie 
entry thus tends to shape the character of the episode. If the entry calls 
for the mea ni n g of a word, the continuisig jhase is apt to consist of statements 
tell in g how the word in question is used. Lilsewise if the entry for an 

e3Q?lanation of something, the continuing phase will likely es^hasi^ some 
form of argument or description. Oie words "apt'^ and "likely”"^ the preceding 
sentences were deliberately chosen, tt is not necessarily the case that the 
continuing phase will he consistent with the demands of the entry. Ihe student 
may misunderstand the entry. He my not know hew to respond and thereby funfcle 
the verbal exchanges. Or for some other reason the itudent may fail to 
an ^^propriate reiqjOQse. In any event, there is not always a close logical 
correfqpondence between what the entry calls for and what the body of the 
episode contaias. For this reason, the entry is a laore dependable cue to 
the poiport of the ^isode than is the contiouing i^base of the unit. 

H^xptovoTf it will, be of interest later to discover the esetent to 
dlser^peacies are allowed between udiat is deoanded and what is supplied. 

Certain views of t e ach ing ea^basise permissiveness cn the part of teachera. 

This view assumes that a 3^mis8lve atn»^ere encourages student initiative, 
discussion, and creativity. At the same tine, precisian in the of 

ideas and syi^llc operations is prized. It is socially as well as pedagogically 
important to discover the relations between permissiveness and rigor in i ng 
ideas. Were it to tum out that permissiveness and rigor of instruction 
are inversely related, readjustaaits in educatl<aml theory ml^t wtfLl be 
called for. How, the classiflcaticss of episodes by entries would cgspear 
to facilitate the use of ^Isodes in the study of tea*ihing from this standpoint. 



For one measure o? pennissiyeness nay "be the extent to vhich the responding 
excingnges of the continuing phase are alloved to vary from the dessands of 
the entries. Rigor of instructionj on the other hand, may he aiBasu 3 ?ed hy 
the extent to vhich the handling of the body of the opisode measures to 
speoifled criteria of logic. 

2. ^e Devel<^psient of Categories 

At the outset it seeioed possible to select ready-made categories frost 
among those found in general voxhs on logic. If such selection vere possible^ 
the aremaining task vould consist of devising criteria and proc;edures for placiitg 
episodes in appropriate categories. Hovcver^ it soon became clear that no such 
siapie solution was possible. 05ie great variety and complexity of syaibollc 
operations deoended by teachers made it ^Aite clear that opieodes could not 
be neatly fitted into ready-made classes. Zt was nccessaxy to ioHov a more 
empirical procedure— to voxk orxt categories in terms of the nature of the entries 
themselves. Of course^ conventional, categories of logic such as definition^ 
designation^ ajod classification have been constantly referred to in our 
deliberations and some of them appear In our list of categories. is 

necessarily the case. To Ignore such categories would be to iinreat a new 
logic, and that task is not within our doanin. But the oecummce of these 
categories in our list resulted from study of the entries th^’islves rather 
thin from a priori decisions. 

One effort to formulate categories eapirically was focussed an 
analysis of the verbs contained in the entries. It aeeiaed likely that the 
nature of the main verb would be a clue to the logical the entry. 

l!he entry ^What is the bigger part of the brain called? * contains the verbcd 



ea^ression ’*l8— — <ca3J.ed”. eont.a1.ning such es^Tessiosis vould seem to 

fall into a logical categozy of tem-referent where the referent is given end 
the .\ax9e of it is called for* J^Qgdxx^ the expression ”do-— <*4iffer” c^^pec^ing 
in the entry *Hcw do the eyes of the fish differ frcau the eyes of the invertebrates 
that ve hieve teen talking abont? * seenss to indicate eleariyr that this ^txy 
reqfiires some sort of dl6cxi?aittatioa^ a pointing out of the differences 
hetween the eyes the two sets of aniaals^ Altogether we found that there 
vere at least Ihiarty-slx different types of verbs used in the entries. 

For eacaaple, there were verbs such as **know” and **think" \ddeh indicate 
degrees of belief; verbal expressions such as ’*tU 3 » into" and ’’convert" which 
espress s^le change; others called for the grouping of things, for quantitative 
values, outcoBies of actions, and so on* Froiiiising as this approach appeared 
to be, It.be^Boe clear cn flirther analysis that Identical verbs occur in 
q^esUotts of quite different logical lapovt. Consider two entries as a case 
in points '!diat did they decide about the incofse tax?* and ’IShy did you decide 
on angrily as a modifier in & sentence?* • Both of these entries contain 

the escpression "did decide". Yet the first entry asks for a stateaent of 

a decision while the second one aShs for an esg^laaation as to the use of the 
word "angrily". 'Xhe nusber of entries containing the sane type of verb or 
even the same verb, and yet varying in logical significance, r^idexed this 
approadh to the fomaticn of categories ine^feetive. 

A second effort to derive categories ^aiplrically consisted in a stud^ of 
the nouns appearing in entries. It seemed reasonable to euppoas that the 
nature of the nouns would give definite clues to the logical operations re«ilxed 
by the entries. For exsaple, the ^try *Vhat is a neuron*?* Is seen to be 9tlte 
different from the estry *What is a felony?* when the nouns "neuron" and 
"fel<»y" ere taken into account. A neuren is a i^hysical object, i.e., it 



occupies space and in principle is oljservable. A neuron as an object can be 
pointed to or described. But a felony is a status ascribed to acts. Acts 
sucb as Isillin^g, if they occur under certain conditions judged to be 
amder and mrder is a felony. Kos? billing my be ‘Witnessed, It is an 
observable act. But strictly spegkisig murder is not observab3.e. For 
vhetber Isillxng is murder or not is a matter of decision, usually by a court 
of laij, and not a matter of obses^stioa. 

Consider also the entry are sos^ char^terlstlcs of his uritisg 

that you have noticed? * . 21ie central feature of t-hf ,s mtxy seesss to be the 
tern ’’characteristics” . Waatever they a^, scsse of them ssnst be designated 
ia order to rs^ond satisfactorily to l^e entry. Xet ^h&t sort of teia are 
ve dealing .“«?ith? Xs it the same sort as ” neuron" or '’felony”? "CSbsracteristies 
is a tersa of great generality. In its widest scops, it is the name of the class 
of all j^xjperties. It denotes a class of tersis any aember of which isay denote 
the prt^rties of an object. Shus the writing a given novelist may 2mve 
a 32us2ber of properties. It my exhibit a large pr<^ortion of metaphors, or 
great descriptive detail^ or lyric^ expressions, and so on. Each of these 
is a property of the writing sad is a isesiber of the eless of things called 
charas'terlstlcs* Bat the class is not sshausted by the p£%>perties of waritiag, 
for ail prcperttes of all tfeiags belong ia the class cf (diaracteristlcs* 

!She tei^ "relationship” end "differeace", frec^zently used in entries, are 
sisdlar to ”characte;dstics” wi'Ui regard to generality. 

Zt follows from the foregoing discussiem that nouns may be grouped into 
sets by levels of abst-s^tlou as wcll ss 1^* what they denote. We developed 
five major sets of nouns based upon ^e character of their referents and the 
magnitude of their referential distances. 

But, as in the case of our study of verbs, this approach to 3.ogical 
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categories to be abandoned. Xc the first place^ the study of nouus gave 

* * 

no direct clues to logical categories Into uMch entries aii^t te placed. 

Logical cpemtlons, except for definition and classification^ are Independent 
of tbe nouns contained in propositions. IThis is precisely vliat one vould 
esq^ct. To deal with noons^ in the foregoing sense^ is to analyze a concept. 

For a noun is the name of a particular object or of a concept, that is, a 
class of objects. And there is aore to logic then the analysis of comcepte. ^ 
Moreover^ td&e logical demands of instructionaJL activities far exceed those 
by entries calling for definition and classificati^. In the secend place, 
to distinguish among nouns in logically significant ways is to engage in 
concept analysis at levels of hi£^ abstraction. The Inference leading 

from these levels back to the entries themselves is often long and tenuous » 

For this reason, classification of entries in texias of types of nouns, even 
were they logically significant, vould be of doubtful use. 

Another effort to build categories enpirieally led us to look at the 
stems of entries. At the very outset of our efforts to classify entries it 
became deslrsble to them for convenient and easy reference. 

This led to the use of entry Btens as a basis of e<sxvenlen.t clasriificaticn. 
Ordi n a ri ly we use ”ste»” to refer to the openlj^ words of the entzy* 8oms 
entries could not be tiseftdly grouped by the opening woriis, however, and 
in these eases the stem ref ers to other parts — uususily tae verbs or verb 
phrases— >of the entry. The following is the way the entries were thus classified 
!• Verb stems— Can....? Jto*...? Have...,? Is....? Will....? Would....? 

Let us (with a vim^— have, look, see, etc.). 

2. Adjective stems— What... «? Wb^*..,? Where...*? Which....? Who....? 

3* Adverb stems— How. .. •? Why....? 
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h. Conjunction stems— If,,. *? \lh&t (when, how, where, etc.)....? 

5 . Mscellaneous— Agreement asldng {e.g.*That*s the central government of 
Cana^, isn*t it?*); CcmpXetlon (e.g.’Our conclusion is?*); Cou^olete 
Declarative (e.g.*ffliis is considered his hest novel.*); Imperative 
(e.g. ’Keime seme words that are negatives.*); Inccajplete (e.g.*5'or 
what reason (two sides egiial}? * } . 

Hlhese St ^08 afford only a liMted clue to logical categories. Ihe 
"Why....?” and "How....?" steins, due to their limited llagoistic faactxoa^ 
are frequently associated with entrtles that demand causes, motives, purposes, 
ways and means of doing something, and the lihe. Likewise "If. . . . , 5 . . . .?" 
stems are almost always found in entries calling for ccmditics^al reasoning. 

But often stems are more varied with respect to the demands made by their 
entries. For exaaple, "What....?" steiaB are to be found in entries asking 
for all sorts of logical responses, as shown in the following entri.es: 

*^at is a xhori^us? * 'What is the valence of hydbrogen? * ^What of structure 
is the dendron? ' 'What eolation relates these ^psntltles? ^ 'What would 
the nervous system correspond to in a building? ’ *What caoses warts? * 

!Ehe first of these entries asks for a isniqjue descriptioia of a zhaDOnis, 

The second one demssds that a sumerieal constant be ^^ified, *Qie third 
entry re^res that the dendron be classified by its structure. Ihe next 
entry calls for the statement of an equation. The next one that 

something sQbout a building that stands in an analogous relation to the 
nervous systen. be named. G3ie last of the entiles asks that an ea^lenatlon be 
given.. .Yet all these different functions are served by entries having 
"^dzat....?" stens. The sane sort of vaa^tion can be shown, in differing 
deices, for other stems. Sven the "How...?" and "Why....?" stems vary in this 
regard to some extent. *How would you define crime?’ is logically q^ite 
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a dififereat entiy from *How vcfuld you identify an acid? * . !Eie first of 
tlieee is act as k i n g for an account of the procedure '(;hleh the word '’criiue'* 
is defined* Rather it aslss that the word be defined, yurthemsore, this entry 
could be understood as asking for a definition of the word "erline'* as used 
by the person addressed instead of for a dictionazy. or tcstbook definition. 

®je second of these entries calls for a procedure by which acids are identified. 
But, as in the preceding case, the could be interpret 4^1 as asking 

for the particular proeeilure used by the person addressed. Because of these 
variations in the logical demands of entries hairing the easne stem the 
develqpoent of categories by reference to ston» did not seem promising. 

While the three approeches to the developnent of logical categories just 
described failed to yield the desired zesults, they were not vithout value. 

They afforded infoznation shout entries which proved to be usefhl as ve turned 
to the developiBent of criteria, a subject to be treated in the next ehs^er. 
Moreover, from these approaches ve ^dned a familiarity vith certain aspects 
of entries idiieh reinforced the more intuitive fomatloii of categories to 
vhieh ve now i^ppealed. 

As ve begpra to examine a saiqple set of mitries, and to lodk at eadi entry 
as a whole, ve soon became acware of the fact that the logical character of an 
entry could be decided by reference to the sort of rei^ponse it demands. 

When ve speak of response, ve of e^Msnse do not vaom the actual response, that 
is, the response which the student made and vMeh can be found by examining 
the continuing phase of the oplnode* It vlll. be recalled that this response 
vas eliminated at the outset as a basis for classifying episodes. Xt vas 
ruled out because of discrepancies vb « ch sometimes ociuir between the 
of an entry and the character of the response. What ve appeal to ia therefore 
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not the actual response hut an idealised response. Such a response is a schema - 
That is to sayj> it is a form to idiiieh responses to the members of a given 
class of entries vould confoaaa, regardless of the content vilh vhich entries 
deal, were the entries uaaaibiguous and the responses logically correct. 

UChe wawifi g of on idealis^^ed response may he i^hrther clarified by reference 
to esanples of entries. entry •fi^vhUh^te did Henna come?* 
that a particular political unit be specified. It le not aeceiiS^ «it 
the state from which he came in order to know that the e»itxy requires as an 
appz*opriate reapo^e that a pa3?tleular state he indicated. Hor do we need to 
know t&e time at which he came from the particular state. Vere we asked to 
give an ectual rather than an ideal reapoase^ we would want th© ambiguity 
removed from the entry by specifying time. Mark Hanna might have come 
from Hew York, or anyone of a number of states, depending the occasion. 

In the sense of nativity he could hacve come from one only ouft state. 
Furthemore, an Idealized response may he made in more than one way. In the 
present case the particular state could he specified by naming it, by pointing 
to it on a map, or by fikettdilng its shi^e, and so on. •Which is the base 
of the triangle?* is an entry which likewise rs^ilres that a particular something, 
namely a line, be speciflel. «iihat is the word (la the sentence) that is to 
be modified?* slmiaarly rcerlrsr that 8cnething«-a word— be singled out. 

We can how g ene r alize idiat we have been doing aay* that there is a set 

I 

of entries idiieh deaenis as a rebponse schema that particular 
specified by tagalng or by pointing. 

In contrast to the foregoing entries are cases in which no particular 
thing is called for.: In the entsy *What is some food material that the fish 
could use? * it is clear that food material Is to be indicated. But the phrase 
sooae food material” is a variable* *l!h.e entry therefore does not demand that 




a specific food item "be indicated, i^nyone of a number of foods could be 
named each of vhich would satisfy the demands of the entry equally well. 

In these cases the response schema consists in naming or otherwise indicating 
any one of a number of values of the variables satisfying ihe fanctioa of the 
entry. 

Some entries demai more complex response schemata. ’How did KcEinley 
happen to be killed? ’ requires that a sequence of eweirts leading to and 
ending in McKinley’s death he sielated. ’How did they finally relieve this 
beleaguered garrison? • is an entry which also recounting of a 

events e n d in g in the relief of the garrison. A similar response is to 
he made to the entry ’in the East, what had Cleveland done that made the 
Capitalist unhappy? ’ . Here the response consists in narrating the acts of 
Clf ^land that led to dissatisifaction among the financial leaders. Thus 
ve have a response schema which consists in the narration of a seqiixence of 
events leading up to and culminating in some pirticuXar state of affairs. 

This state of affa?'^ is said to he the result or outcome of the ev^ts, 
the events are said to explain or to account for the outcome. Again^ it 
is not necessary that we know what the actual events were in order to tell 
that an entiy demands the narration of events as a response. 

3* Kinds of Entries 

The foregoing discussion is peadjaps sufficient to indicate the way 
in which we arrived at a set of logical categories. Without any ihrther ado 
we will now list the categories into vhich the entries were groiq^ted* 

Entries m a kin g this group are c<aicemed with how 
words or other syaibols are used to refer to ohjocts (abstract or concrete). 
These entries vary in form and content, but in general they ask lapllcitly or 
explicitly for the meaning of terms. 



In scoae cases^ a term is given and a definition or meaning of the term 
is to be supplied as a response to the entry. In the exes^le^ *^7hat does the 
vord "dorsal’' mean? * the question requires that whatever is designated by "dorsal” 
be indicated. 

In other eases^ neither the word "aean" nor "define” occurs in the entry. 
Rather the entry asks what something is, for example, *What is a cablegiem? » . 
These entries requLlre that the noun appearing in the question be defined, or 
that the referent of the norm be described. 

In a few cases, the noun in the entry is a gramoatically proper name. 

In these cases, the entry reqjuires that the object designated "by the proper 
name be described or otherwise Indicated. For example, 'Mho yias Paul Slmer 
More? * Is a question which asks that the person referred to be described 
unambiguoiisly. 

Fi n a l ly , some entries auik for a term or expression that can be substituted 
for another term or ea^ression, for exaaple, *Vhat is the synibol for gravity? ' . 

2. teBeribtog. To describe is to represent something by words or drawixig, 
to tell about something* Thus the entries maigiwg iqi this category nentioii or 
suggest something and require that an account of this something be given. 

In the qiestion 'Rhat can you tell os about the gill rakers? * It is clear 
that we are asked to describe the gill rakers. 

However, not sdl questions which mention or allude to something ask for 
a description. Fbr example, *Ubat would be some ezanplsa of a sense organ?* 
is a question which names a class of things and asks that instances of it be 
cited. Ho deseripticm Is called for. 

In some cases, as in the exaaple just given, it is easy to tell whether 
the entry reqii^s e desctr^ption or an identification. But in a large nosflDer 



of entries the intent of the entry in this regard is obscure. 'What did 
Clefveland find out? * is a question which xnigjht be answered by namng whatever 
it was that Cleveland uncovered. But our expectations would be more nearly 



Satiisxied were; the <j[ueiitxOu aiunfereuL by a brief aecuuut of vhat he found Out. 



On the other hand, *What is a consoon defect of this part ^cerebellum) of the 
brain? * can plainly ba answered by nantf.ng the defect. But a description of 
the defect would not be inappropriate as an answer. 

3 * Designating . To designate is to identify something by name— word or 
other s;ymbol. Ihe naoss designates the object (abstract or concrete) to which 
it refers. Thus this group of entries is xaade up of items in which scoosething 
is described or otherwise indicated, and the name used to refer to it or to 
identify it is asked for. These entries vary widely in form and content. 

In general, they demand that objects (abstract or concrete) be designated by 
nsnie or other symbol, or slisply by pointing. Consider the question do 

you call a word used to ssodify a verb? ' • The ^estlon is answered by giving 
the name of the word, namely, ^adverb” . The qmestiem 'What rutile did he 
show in the film? * is answered in the same way— by giving a name— although 
the question does not explicitly ask what the reptile is called, i^galn, 

*ldiat is the word (in a given sentence) that's to be modified?' is a fpiestion 
which can be answered by pointing to the particular word or by saying it. 

Designatix^g my take the . following forms. 

3.1 The entry demands tlnsit an example or instance, or a nusiber of examples 
of a group of things be named. 

3.2 The entry gives a set of things and It requires that all miobers of 
the set be named. 

3«3 Ihe entry gives a ps^ieular class or gxmtp of things, or a particular 
object, and requires that it be specified by name or by pointing. 



3*4 The entry desciribeB or suggests something and asks explicitly for 
its naise or for vhat it is called. 

k. Stating. Entries in this groi:gD do not ask for names . descriptions. 
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steps in proofs, rules, obligations, theo3?em8, conclusions, ideas, beliefs, 
ppoinises, threats, etc. yor exanple, the ^stion *What is the conclusion? * 
asks for a statenent of some sort. Xt can seldom be answered satisfactorily 
merely by nanlnge 



SeporblBg. The entries in this gix3^ ask for a report on what a 
book or docutBent says, for iofo^satlon in the text, or for a snssaary or 
xe?iev, and the lilce. 

6. Substituting . The entitles making vp this category ask the student 
to perform a sysibolic opemtion usually of a oathenatical nature. 

y«li»ting. To engage in waluating Is to estimate the worth, dependability, 
etc*, of sces^thing. An entry of this type reqadreB that some object, ^ipiressioii, 
event, aeticn, or state of affairs be rated as to its value, dependability, 
desirability, and the like. For exansle, the ^estl^ ‘Is he a good Judge? * 
atiis the student to rate a Judge who acts in some j^articttlar manner. 

Oipine is to eapress beliefis, usually based on little or 
no evidence. Such beliefs arc about what is possible, what sde^ht have been 
and is not, what might obtain in the future, or the like. »l)o you think that 
historians will say that Wilson was ric^t in proposing theX^HP^ of Ifeticsis? * 
is an entry xdiich asks for a conjecture about how historians of the fb;bu^ will 
Judge Woodrow Wilson with respect to a partleuler set of actions— those j^volved 
in proposing the Iteague of Shtiona. 



Piasslftri ngf. Each entry in this grat^p aahase^licit reference to 
an Instance or clsiss (type, sort, group, set, kind) of things or both. The 



entry reguii^s that a given instance he put in the class to which it belongs, 
or that a given class he placed In a larger class to which it belongs as a 
subclass. For exanple, ‘What special type of triangle did you find it to he?‘ 
is a question which sishes reference by the word ”it" to a particular triangle. 
!Che student is e^g^cted to tell what class of triangles this particular one 
belongs to. As an lUustmtion of questions which ask that a class be placed 
in a larger class, consider the folloving: ‘Vhat gro\:^ of animals does the 

Jellyfish belong to? * . Infills question, the tern "Jell^ish” does not jefer 
to a particular Jellyfish but to a subclass. Ohe student is required to name 
the larger class to which the groiq? of animals called "jellyfish" belongs . 

Coitgarir g and C<aitrasting . Ihis type of entry requires that two 
or more things->-actions, factors, objects, processes, etc. — ^be con^pared. 

In scone cases, the entry specifies two or more things, and asks that either 
their similarities or differences be noted with zespect to a particular 
characteristic. The question ‘Ifiiat*8 the difference between probation sn d 
parole?* illustrates the first of these cases* The student is asked merely 
to make a eon^parlson, the points of eooiparlsaa not being explicitly indicated. 
The second case is illustrated by the question, *Is his (fife's) eye very large 
cooopared to the size of the grasshopper's?* Here the eyes of the two different 
animals are to be coopared with respe^ct to size cmly. 

In still other cases, the entry names a thing and re^iires that another 
thing si29llBr to it, or different from it, be indicated. Consider the question 
'Which OKie (Canadian house) corresponds to the House of Conmons? ' • The House 
of Commons is the given object. The question asks that the Canadian house siost 
like it be named. Entries of this kind do not require that differences or 
similaritieB be explicitly stated. The student considers the differences or 
likenesses and selects the object in tezns of them, as z^qjuired by the entry. 



IX. Conditional Inferring. IQiis category conGists of entries each of vhlch 
contalQS an antecedent^ that is, the conditional part of a statement. In the 
sentence ’When it rains, the streets are vet*, the phrase ’’When it rains" is 
the antecedent. Ihe phrase ”Xhe streets are vet” is the consequent. Nov, 
the entries which make this category give an antecedent. Soosetlmes they give 
both an antecedent and a consequent. But they never contain a conseqiuent alone. 

Here is an exaitiple of an entry contalnisg an antecedent only: *Hov does 

that (undemocratic handling of colonies) affect the xaother country?' !I3ie 
phltoe "uBdeiaoeratic handling of coXonies” is the antecedent. St describes 
the condition of which the effect on the mother country Is the consequent. 

!Che ^stlOQ asks the student to tell what the consequ^t Is* ^fake another 
ease: 'If diagonal (in rhonibus} is given as 12 and this angle Is 60 , 

vhst is i&e aagle at C axid at A?*.. !£be antecedent is 'If tliat diagonal 
(la xhoabas) is given as 12 and thin ang^e is 60* . ?!he conseq^t aaked for 
by the qpaation is ”Whs:.t is the size of the angle at C and at A?”. In all 
eases vhere the antecedent alone is given, the entry req^res that the 
conseq:tent"- effeet, result, outeoaiB, subsequen t behavior— be supplied as 
the answer. 

Consider an ezaiqple of an entry containing both an antecedent and a 
consequent: *X)ld you ever get a headache from sleephig in a draft? ' • !Qie 

l^rase "sleeping: in a draft” is the antecedent, and ”get a headache” is the 
conseqaent. Nbw, in entries of this sort, the student is reqiired to affirm 
the consequent, to deny it, or to say he does not know idiether he has ever 
suffered or enjoyed the consequent under the given crmdltion or not. 

Some of these entries asks for value judgnmits, some ask for statements 
of result or butcome, and others for descriptions of actions, decisions, and 
the like. 



12 , Es^l alnin g * !Ehcre are sev’eral types of esplanatiOQ &atTi.eB “but they 
all have one th i n g in common. Biey give a particular cbnescpient and they regiilre 
that an antecedent be supplied. To esjplaln is to set forth an antecedent 
condition of which the particular event to he ea^lained is taken as 1^e effect, 
or else, to give the rules, definitions, or facts which ere used to justify 
decisions, Judgments, actions, etc. In the example *Why did the li^t go 
out? ' , the conseQjuent is ’*the Xi^t go out” . The ^estion asks the student 
to give a reason or reasons to account for the fact that the light is out. 

The reason(s) is the antecedent. 

There are six kinds of explanation entries, depending upon the sort of 
antecedent used to account for the conseqiient. They are mechanical, causal, 
sequent, procedural, teleological, and nonoative. These are described as 
follows: 

Explaining . This type of entry gives an event or action 
vhich is to be accounted for by describing the way the parts of a structure fit 
or work together, A sample entry will help to make this category clear: *Row 

(do fisdi make a sound)?* The action to be accounted for is ”flsh a 
sound the antecedent consists of scaae kind of structure which 

the fish to make vibrations, A description of this weftbAniewf^ would constitute 
an answer to the entry. 

ExpXa inin f ^ . Entries of this type give events, situations, 
or states to be accounted for and ask that a state of affcdrs be cited of vhich 
the given event (or situation or state) is taken to be the result. Ccnsider 
the exaaple: *Vhat makes a person’s muscles sort of twiteh-like?** The event 

to be explained is the twitching of a person’s muscles. The explanation consists 
of a description of the condition of the nerves associated with the twitching. 
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12.3 Seqiieat Bxplainiag . Entries of this sort ask how soaething happened. 
•Skey reigpiire that a sequence of events he cited of vhich the event to he accounted 
for is the sequel. For exaijple, the question, »How did McKinley hs®pen to he 
killed? * reqaires the recitation of the events leading to the sssassination 



of President McKlxiley. 

yyoeedmal Expla ining . Ohese entries require that the stqps or 
opexatlcns hy which a given result or end is attedned he described. Here is 
a saa^le entry: ’How*d you get ?2 (for an answer)? •. It is esqpected that 

the student tell the steps he took to obtain this asisuer. 

12.2 teleological Eaplalning . this type of entry contains deserlptions 
of actions^ deeisions^ states of affairs^ or the worth of things. It re^ilres 
that these he accounted for or justified by reference to piirposes^ functions^ 

OP goals. An entry of this sort is: *WlQr are you doing those problems?* . 

Bow^ the conseqiueEit to he explained is "doing those prohlesss**. ovy t 

ecssslsts in giving a purpose^ say^ to satisfy an assignment. 

Explaining . Entries of this type do either of two things. 
Firsts they x»y mention or assume a decision, judgment, or state of imowing and 
zeqiire that it he justified by citing a definition or Oharactea^stic or both. 

Here is an example: ’Why do we call then {coulmals between vertebrates szid 

invertebrates) the (Shordata animal group? * . Ihe consequent Is the underscored part 
of the question. To give the antecedent In this case Is to cite a definition 
of the chordata and to point out that the tmivAia juu qiuestlon have the 

charaete3?l8tic8 called for by the definition. 

Second, m e an bers of this group of entries cite actions, decisions, or 
choices {either made or to he m ade) and require that rules be given as reasons 
for the deelslons, dholces, etc* Consider this exaaple: *Wby do ve use 

shorter (in eonparing two pencils as to length)? *• The cuaseqxent to be 
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is "we use shorter" e !Eie antecedent dexoanded “by the ^estion consists of 
,a inle prescribing the use of "shorter” in such csases. Entries of tliis type 
^usually call for grazBD&t.lc&l or xoathemtlcal rules. 

13 • ]KLre cting and Mana gi ng Cl&asvooan, Mnnv mAsi-.-r Olflft Tvir 

wmmw , - - ^ V ft# 

have little or no logical significance. !£hey are designed^ not *fco evohe t hr^ xg ht j 
but to heep the classfoomi activities jnoving along. Qciestlons of this sort 
belong in this category. 

4 . Hotes on the Logie of the Categories 
S’ive of our categories vill be readily recognized as logical categories. 
8®^2nition is a standard topic of logics so are designating^ classifying^ 
cwidltional inference, and substituting. The first two of these are related 
directly to the questions of linguistic clarity. These operatiosns are used 
as we s^k to fommla'te the rules by iihich words are used a«d to specify the 
referents of our terns. Classification is of course a fundajoental topic in 
logic. Its relation to definition and categorical reasoning is too well known 
for cobment. What we hexce call conditional inference is usually treated under 
the heading of eozidJtlonal azgiment or hypothetical reasoning. Substitution is 
treated In elementary logic in connection .with the subject of definition, as 
in the substitution of foms. Xn syaibolic logic it is a primary operation, 
the exchange of one cs^ression for another or Its replacement by another being 
subject to rules of substitution. 

fisqi^lalnisg, valuating> and cos^aring and contraatlng axe not xeadlly 
recognized as logical categories. Explaining has greeter elaixi to such a 
status than the other two terms, using the sinple rule of topics treated 
in elementazy works on logic. SiQgilanation is dealt with in a nunSxsr of general 
logics, at least in the limited sense of exg^lanation by subsungption under a 
general rule of tho particular Instance to be explained* Sut other forms of 
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explanation are treated mlnly in store general vorks In pklloson^y. Valuating^ 
as everyone knovis^ is a hl^ly contzmersied subject in botk phlloeo]^ and 
Sducatioa. Soiae authorities hold that 'mluation is^csely an expression of 
approval or disapproval of one's likes and dislikes. From this standpoint 
valuation has no logical status whatever^ it being merely a psychological 
disposition called, attitude or vhat-not. In sharp contrast is the view that 
valmtion is in principle the sazae as a factual clalm^ it being zedeeioable by 
reason and observation as becomes any ezpirical assertion. Valuation vould 
in this essa be subject to the rules of loglc^ even though it vould not 
itself be a category of logic. Between these tvo extremes^ a mxidber of other 
positions are to be found vith respect to the cognitive end logical status 
of valuation. It is clear from transcripts of classroom discourse th&t sonn 
valuations are e^qpressed as likes and dislikes, others as Justified preferences, 
and still qihcrs as natters of faict. Turning tusw to and contrast, 

ve cone upon primitive operations, so primitive in fact Jutt they are usually 
tak.en for granted in voxks on logic, even though they are Involved in classifleation, 
definitlcn, and in other operations raguiring distinctions among either concrete 
or abstract objects. At the psychological levels they are acts of discrimination. 
From a logical standpoint, they can be treated in terms of the logical relations 
of sysnetry and transitivity. 

The remaining categories in our list are not as distinctly logical as 
those ve have Just discussed* !Ihe category of Directing and Managing Classroom 
is clearly non-*loglcaX. It is included for the simple reason that all entries 
were to be classified vhether they vere logical or not, and, since entries having 
to do vlth classroGm mechanics vere of little or no logical significance, a 
non-loglcal category vas included in our list. Stating and reporting as veil 
as Opining are not treated in general voxks on. logic. They are logically 
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signif ic839it> however^ in the sense that \diatever Is stated or reported to 



he the case^ or asserted as an opinion, can be tested as to its truth. 

However, it shoold be rexoadced that some opinions are apparently beyond the pale 
of enpirloal test, ^ose opinions which consist in contrary to fact claisis 
are of this sort. For exaopXe, the opinion that KSpoleon woold not have lost 
th6 tattle of Waterloo had he not loade the Koscov caapaign is one for which no 
direct enpirical evidence can be adduced. Sutdi opinions nay be useful in 
discussion^ and even In scientific reasoning, but they remlh.as unsuhstantiated 
claims. 

Finally, ve consider the category of describing. !!!his category proved 
to be very aidbigaous. Uhls f^t is to be attributed to a nuiober of things. 
Fexhi^s the most significant of these is the fact that description, as it is 
used in philosophic literature, suffers from a variety of uses. Sbus ve say 
of a scientific lav that it is a Ascription of nature, of the expression 
^'Socrates is a man” that it is a description of Socrates, of tiie narrative of 
a battle that It is a description, and so on. Bassel.l*s distinction between 
ainbigoous and definite description appeared at first to be useful for our 
purposes. *Qms, according to Bussell, to say that Socrates la a man is 
eahlguous in the sense that he could be any nan. Definite description, on 
the other hand, would be one idiich singled Socrates out end distinguished him 
from other men* ^nais Socrates was the man who taught Plato and died in Athens 

diinking heodock In 399 B.C., wotild be a tini^ description. There is 
one and only one such man called Socrates. We atteopted to ua^ this precise 
meanlDg of description, but the ashiguity of the mrtrtea precluded this 
posslblliiy. We thus turned to a less rigorous definition of description, 
reducing its meaning almost to the level of ordinary usage. 
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From the foregoing discuosian it can be seen that the present set of 
categories may be considered defective in at least two ways. For one thing, 
the categories are of different orders with regard to their logical significance. 
Soane of them rej)resent schematic operations. For exanple. defining involves 
the giving of a class and the characteristics which distixigulsh within the 
class that which is being defined. 0?6 this operation certain rules can be 
applied to decide whether or not the operation was properly 3 pcrformed. 

Opining, on the other hand, seems to involve no such operation. It is merely 
an ejtpression of belief, logical rales are explicable to the ppeiations of 
testing a beUef s:q?ressed as an opinion, but they cannot be applied to the 
eaqpression of the opinion itself. Also, as we have noted, the category of 
classroom nsnegement is altogether non-logical. 

For another thing, the categories overlap. Description seems to spread 
to ahnost every category. We eaiplain by describing, as in seqiaent and mechanical 
explanation. We describe when we tell the slmllardtles and differences among 
objects or when we classify things. We give veluatlosus when we utter certain 
o pin io ns and we express opinions idien we make certain valuations. Ulhese 
few instances are perhaps sufficient to indicate some of the problems which 
remain to be dealt with as our voxic moves in the direction of zaore adequate 
ordering of the categories and more xlgoroos definitions of tlliem. 
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CHAPTER VI 

CRITERIA F’OR CLASSIFUKG ENTRIES 

We turn now to the question of how entries by *Mhlch episodes are to be 
classified are to be placed in the categories set forth in the preceding 
diaptero To classify entries it is necessary to satisQr two eoniltions: 
first, m inust forraalate criteria by which to decide the category into which 
any entry is to be placed; and, second, these criteria nnist be tested for 
the degree of consistency with which different observers, using these criteria, 
put the saiTie entsriss into the same categories « 

1* How the Criteria Were Formulated 

We developed the criteria from a set of entries taken from a sample 
of transcripts covering all the subject-matter fields represented by our 
coinplete set of tapes* There were approximately 11^00 entries in our sample 
set. Each entry was typed on a strip of paper for convenience in handling. 

Two investigators working separateiy developed the criteria. They followed 
the rough procedure of trial ani error* One investigator worked through 
part of the sample set of entries, putting each entry into the category deemed 
to be appropriate. The gross experience of classifying entries in this way 
led to the formulation of a few rules. As oiher entries were classified, 
additional rules ©fnerged. Ti^hen this investigator had worked throu^ the 
entire set of entries, the rules he had formulated were given to the second 
investigator who then attempted to classify the entries by the rules. The 
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difficulties encountered hy the second investigator were discussed and the 
tentative criteria were inod3.fied to obviate the troubles* this to and 
fro ejsr^snge between the two workers ^ the criteria were put into semifinal 
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sample of entries. Thegr then compared their classifications^ noting the 
agreements and disagreements, and making sudi changes as their deliberations 
called for. The criteria thus revised were used as the working set. This 
working set is reproduced in the next section. 



2, The Crj.teria 



1. Defining 

1*1 Criteria and Sx:aTnples 

1.11 A term is given and the definition, meaning, use, or what we 
understand by the term is explicitly asked for, 

1.111 !tot does the word ”pons” mean? 

1.112 Vhat*s the definition of felony? 

1.113 Couldn’t ’^weH" be used as a judgment, exclamation? 
I,ll2i How would you define that (crime)? 

1.12 A term is given, and the entzy asks (iitiplieitly) what the 
referent cf the term is, 

1.121 Miat Is the mid->brain? 

1.122 VJhat is a cablegram? 

1.123 ^at is nationalism? 

1.13 The name of a person or aty object, (lace, or event having 

a grammatically proper name Is given, and the entry asks who 
he (she) (was) or what it is. 

, 1,131 Who was John Hay? 

1.132 Itio is John Adams? 

1.133 What is the Monroe Doctrine? 
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A texm or expression is given, and the entry asks for a symbol 
or other expression that takes the place of it. This type of 
definition involves a shorthand expression. The shorthand 
expression is given, and the longer expression is asked for, 
or vice versa* 

l*lUl ^/Ihat is the for time? 

1*1U2 S means what? 

I.lli3 Is h the height? 

l*ll(lt £ means x^hat in the formula? 

2, Describing 

2,1 Criteria and ES^smples 

2.11 The entry asks what 5Ls (was) happening, what happened, has 
been happening, had happened, etc. 

2.111 ^‘^at*s happening in South Africa now? 

2.112 X^t happened :dth the Ind^endente? 

2.12 The entry asks for an indefinite description • can you tell 

us about so and so, what can you teU us al^ut so and so, what 
about so and so, how about so and so. 

2.121 Can you teU us anything about the schools of New Zealand? 

2.122 XiJhat can you tell us about the amoeoa? 

2^123 Xftiat else can you tell us about the nematode? 

2«1^ What about the skin of the frog? 

2s’ 2 $ about the surface of the moon? 

2*X26 Anyone add anything to -^t (discussion of boron)? 

2.13 The entry asks about the purpose, aim, or function of somethii^. 
2.131 What else does the pupil of the eye regulate? 

2.13? What are some of the functions of the liver? 

2.133 ^^at is the aim of the triple A? 

2413k What are ncuns supposed to do? 



2 o 135 does the governor on a motor do? 

9.0I36 Xilhat are we supposed to fir*d out? 

The entry asks explicitly what the relationship is betvieen 
two or wore things « The word "relationship**, "related", or 
’’relations" appears in the questiono 

2o3l}l What is the relationship bettireen the big dipper and 
the north star? 

2oli|2 How is spelling ability related to reading ability? 

The entry asks what something (object, word, institution, 
etc«) is used for, or the uses of it, etc* 

2ol^l t'^hat is another use for hydrogen? 

2*1^2 ’.'Jhat is police power used for? 

2ol53 are some of the uses of marble? 

2.16 The entry asks what something (indivi.dual, object, institution 
etCo) did, was doing, what was dore with something, what they 
did, etc® (If the question asks the person addressed what he 
does, did, has done, etc., it should be placed in 2a2? rather 
than here*) 

2ol6l I’Jhat had Wilson succeeded in doing before the war broke 
out? 

2«l62 Did the 0, S, go in and take the territory? 

2*163 What did they do with it (treaty agreement)? 

2.17 The entry asks about the form, appearance, composition, etc*, 
of something, 

2.171 VJhat does a landau look like? 

2.172 How about the form of a lamella? 

2*173 What is lampas made of? 

2,17li TiJhat was that scene like? 

2*18 The entry asks what was found out ty someone who is not a 
member of the class* (If the question asks the person 
addressed what he found out, e*g, ’What did you find out,* 
etc*, it belongs in 2*29*) 
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2*181 Xiftiat did Darwin find out about the emotions of man? 

2ol82 What did the main character discover about himself? 

2.19 The entry asks what the properties or characteristics of something 
are$ whether something ever had or now has a particular property* 

C.191 Anyone have acy other propex^ies of chlorine? 

2ol92 What are some of the physical and chemical properties 
of iron? 

2,193 What are some of the characteristics of John Marines 
paintings? 

2.19U Did man ever have scales? 

2.195 What else is characteristic of the reptile? 

2.196 yfbst (to the whales have? 

2.20 The enbxy asks what is the problem of sontething (animal^ person^ 
naticsi, etc,} 

2.201 ^^hat M'as one of the first problems faced by the 
Constitutional Convention? 

2.202 What are the problems of the polar bear? 

2.203 Can you name one of the problems Washington faced as 
a general? 

2.21 The entry asks whejre - where something comes from, where it 
is located, where it gets its name, etc,, where something 
was done, where it is found, and the like, (Questions which 
ask where something was discussed or talked about in the course 
belong in 2,28,) 

2.211 Where are the kidneys located? 

2.212 IVhere did £!ooker T, Vfeshington get his first name? 

2.213 He wasn*t bom in Salem, Illinois, was he? 

2,2lU Where is Singapore? 

2.22 The entry asks when • when S(3inething happened, what time it 
occurred, etc, 

2,221 Do you know what time It was (that Cleveland served 
as President)? 

C,222 When was the Spanish ibnnada destroyed? 
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2*23 The entry asks explicitly for a description. The wcrd "describe” 
is used in the entry. 

2.231 Will you describe the way the inain character looked? 

2.232 How would you describe the landing of a plane? 

2,2U The entry asks how many there is of something, or how long 
(in a temporal sense or otherwise) something is, and foi’ a 
numerical value of the area, volume, valence, etc,, of a 
particular something. All questions asking for numerical 
value of variables or constants go here. 

2.2U1 Hew many bones are there in the human skeleton? 

2.21(2 How long did the Civil War last? 

2.21(3 The area of the triangle is? 

2,2l|l( The sum of the squares equals what sme-ant? 

2.^5 What is the valence of the (Sp|^) radical? 

2.21(6 What is the altitude in this triangle? 

2.21(7 V^t is the size of that angle? 

2.2^ The entry asks how the person add^ssed or the class at large 
feels (felt), whether or what he (it) understands, what he 
(it) thinks of, etc. 

2 » 2$1 Did you like that piece of music? 

2.252 Do you ever feel moody? ... 

2.253 Understand (an explanation in a physics problem)? 

2.26 The entry asks either the person addressed or the entire class 
what he (it) notices, has seen or heard, or whether he (it) 
has read about something, what he (it) learmed, etc. 

2*261 T^Jhat do you. notice about the fish in the aquarium? 

2.262 Have you ever heard of the snowbird? 

2.27 The entry asks the person addressed what he does, has done, 
what he has or has had. 

2.271 Do you have headadies? 

2.272 Did you ever handle snakes? 
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2 <,28 Tha entry asks what the sotirce of information is, (not what«s 
contained in the source), where (but nob what) something was 
talked about, where one found cut about something, etc, 

2*28i %ere did you learn about the principle of flotation? 

2.282 Were you there when the speaker told about the origin 
of coal? 

2.283 page is that on? 

2.29 The entry asks the person addressed what he found out about 
something* (If the entry asks what was found out by someone 
who is not a member of the class, it belongs in 2^18,) 

2.291 ’^’hat did you find oirt about race horses? 

2.292 What have you discovered about the way to extract potassium? 

2.30 Ihe entiy asks what to do, or what the means are, to reach 
or attain certain ends, 

2.301 l-^hat does one do tp grow unblemished peaches? 

2.302 What must we do to find the volume of a cylinder? 

2.31 The entiy asks whether something exists, 

2.311 Does Japan have a king? 

2.312 Ax^ there vestdg|jii3l structures in the human body? 

2.32 The entry asks whether (but not by what means) something is 
<^anging, has changed, ets, 

2,321 Is the earth’s surface becoming smaller? 



3*. Designating 

3»1 Criteria and ^camples 

3,11 The entry msy ask for any one of the follcwing: for an example 
or instance, for either one or some members of a set of things, 
for something else about an object (abstract or concrete) 
ai^a^ introduced, for bt^r gproups or types of things than 
those already mentioned, Entries of this type usually contain 
such words as "example", "one", "some", "a" or "an", "another", 
"other", "what else". They never ask, esqplicitly or implicitly, 
for all menders or for a particular member of a set of things, 
(Entries which ask for examples or instances of reasons, beliefs 
agreements, and the like are to be placed in k rather than here. 



o 



I 

il 

I 





I 



6:6 

, 3o3Ii Give me another type of highway accident. 

3.112 In?hat is an example of words spelled alike but pronounced 
differently? 

3 0-113 Can you think of any other types of government? 

3ollb Give me a substance that dissolves in water. 

3«11^ l^ame some words which have the same form for bot;h 
plural and singular. 

3.116 What else is heavily restricted by tariff? 

3.12 The entry gives a set or class of things, and asks that all 
members of it be named, listed, or enumerated. This type 
of question differs from those in 3cH in that It requires 
implicitly or explicitly^ that all rather than son© members 
of the class be named. (Questions which ask for the mere 
listing of reasons, beliefs, etc., should be placed in U 
rather than here.) 

3.121 What are the parts of speedi? 

3.122 Which states did Wilscn speak in during his first 
campaign? 

3.123 What are the different parts of the heart? 

3.12U Kame the conponents in that diagram. 

3.i25 ^“piat are the races of man? 

3.13 The entry gives a particular class or group of things, or 
else, a particular object (concrete or abstract), sudi as a 
word^ a line (in a geometrical figure), a biological entity, 
and it reqtdres that these be specified by name. 

3.131 What would you find next to the nucleus of the cell? 

3.132 What is the longest bone in the human body? 

3.133 Which part of the brain is the lowest? 

3ol3ii Which word is to ha modified? 

3..1U The entry describes or suggests a particular pe^on, a character, 
social group, institution, and it requires that these be 
identified by name. (Same as 3«13 except that persons, social 
groups, and institutions are Involved.) 
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3.3i»l Who made the "Cross of Gold" speech? 

3alli^2 What is Idle lotrer house in New Zealand? 

3»3ii3 Whom did th^ select for the campaign inanager? 

3«llih Which sroun ot oeoole sunnorted the m volnt‘1 nn? 

3»15 Bie entry asks explicitly for the name of something or for 
what it Is called. 

3.151 Do you Icnow what "strike breakers" are called? 

3.15? What was the name of the man idio nominated Harding? 

3.153 What do we call animals which suckle their young? 

3.152( Can you recall the name of the hero (in the play)? 

3.155 What is the technical name for the junco? 

li. Stating 

1{..1 Criteria and Examples 

U.U The entiy asks any one of the followings What is (was) deduced. 
Inferred, concluded, decided^ reooninended, believed, or wh&t 
are the lssues^> critidsmst, obligations^ etc. 

li.Ul Wbst eritidsm did th^ make of Harding* s administration? 

ii.Ha Does atyone reoaH the decision reached at the conference? 

li.H3 (hzr conclusion is what? 

li.Hli What were Cle^Iand’s obligations on assuming office 
the second time? 

Ii.l2 The entry asks implicitly or explicitly for a formula, equation, 
arules, (theorems, prlndpleSj^ etc.) when not used to explain. 

> li.121 Do figures have to be the same size to be eongiiient? 

11.122 What is the formula for the area of a square? 

11.123 Sewton»s law of gravi1y«>-^t is it? 
ii.l2li The area of a trian^e must always be what? 
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U.13 'tns entry asks for one or more steps or phases in the solving 
of a problem. 

U*131 ^‘Jhat is the first step in the proof? 

U*132 Wxat is the next thing that comes to your ndnd (in 
solving a piroblem)? 

U«lU Ihe entry asks the person addressed ‘what answer (solution) 
he gotf whether he has the answer or not^ etc. 

li.lhl What (solution) have you got? 

U.1U2 hid you get the answer? 

ii.lU3 Which answer did you get? 

The entzy asks or directs the students to practice a given 
exercise (either repetitive or involving the use of principles 
to make calces among alternatives) or to give corrections 
of errors made hy fellow studexts. (Invitations or commands 
to do or to carry on discussions or ix> work on problems belong 
in 13*13 rather lhan here.) 

Ii«l^l ^ve us a correction on that. 

2(.1^2 Head these sentences and use the correct verb form in 
the blanks. 

U.1^3 tJse this word (swiftly) in a sentence. 

Clive me a comparison of these two colors. 

Beporting 

5.1 Criteria and ElTicamplea 

5.11 TSse entry asks for account of ^nat is said about something in 
a docuioent^ book 5 text^ dto.« or idiat is ^own on TY, etc. 

5.111 Did the text oay anything about Hamilton's economic plan? 

5.11.2 What did the; treaty say about ihe ri^ts of the Indians? 

5*12 Ihe entry asks that the information given in the text^ eto.f 
<^bout a problem be stated. 

5.121 Tell us what is given* 

5.122 What do we have given? 



^.13 The entiy asks for a summary or a review, for 'what an individual 
recalls about the class work,, and the like« 

5*131 Sum up what we have been doing, 

5.132 VJhat did we say about the public control of business? 

5.133 ’^hat do you remember about Jackson’s attitude toward 
the bank? 

6, Substituting 

6,1 Criteria and Examples 

6.11 The entry asks or directs the student to multiply, substitute, 
etc, 

6.111 Kultiply it for him, 

6.112 Substitute for us in this equation* 

6.12 The entry asks or directs the students to simplify an expression, 
etc, 

6,121 Simplify it for us, 

7. Valuatiiig 

Perhaps the most reliable (but not completely dependable) verbal 
cue to these entries is the occurrence of such words as "bad”, "good", 
"mistake"} "ri^t", "safe", "true", "freedom", "strong", "new*’. 



7,1 Criteria and Examples 

7.11 The entry asks whether the action (decision, feelii:g, etc,) 
of an individual or group is right, just, democratic, strong, 
etc, 

7.111 Do you think President Truman did right when he removed 
General MacArthur? 

7.112 Was the sit-down strike a sensible thing? 

7.12 The entry asks whe*iiher an institution, law, social policy, 
or practice is right, just, good, bad, etc, 

7.121 Xii a law requiring a person to belong to a unison bad? 

7.122 Didn’t the anti«trust legislation rob people of their 
rights? 

7c 123 Do you think the parliamentary system is very good in 
emergencies? 
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7®13 The entiy asks idiether a physical or biological object or 
characteristic is important, valuable, etc# 

7cl31 Is the fact that man has the thumb veiy important? 

7*132 Do you think that silicon is vezy valuable to Americsn 
industries? 

7*lli The entry asks whether an operation is satisfactory, a bit of 

evidence is sufficient or adequate, or an assumption, statement, 
conclusion, etc* is true, safe, sufficient, and the like, 

7,litl Would that be a satisfactory way to measure humidity? 

7*Hi2 Is that a safe argument? 

7#lli3 What about what ttie newspaper said on toll roads«-is 
that true? 

8, Opining 

8,1 Criteria and Sx:ai»ples 

8,U. The entiy asks for an opinion or belief about the disposition 
or feeling of an historical individual or social group toward 
soraethiiag which happened or existed after his (their) time. 

8,1.11 Would Hamilton favor le^slatlon to help the fazmier 
today? 

8|,.112 Do you think Napoleon would favor present F^neh foreign 
policies? 

8.12 The entry asks for an opinion about how an historical individual 
or group felt or thoi^t about something viiich happened or 
existed during his (their) time, 

8,121 Hoit do you think the Romans f^t about foreign conquests? 

8.13 The entry asks for an opinion about what an individual or group 
will say or do in the future (immediate or remote) about something, 

8,131 What will the next generation say about the administration 
of President Truman? 
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8*lU The entry asks for an opinion about wheth^ something is 
possible or noto 

8,liil Can a snake do that • climb a tree? 

8*ll}.2 Do you think you can learn to do that -» type 100 words 

M AXA VW «• 

80IU3 Can one also use *a « s^?» 

8olJ? The entry asks what a person or group lacks^ what would benefit 
him (them), what you (they) would do about something, and the 
like* 

8,*'5l ^'Jhat do you thirilc the school needs most of ell? 

8*1^2 Would an incoir® tax benefit the poor? 

8.16 The entry asks for an opinion about whether something is necessary. 

8.161 Did President Roosev^t have to declare the bank holiday 
to save the country from complete disaster? 

80I62 Does a fish have to live in water? 

I 

9. Claissitylng 

I 

The most (but nob completely) dependable verbal cue for the identificaticn 
of these questions is the occurrence in the question of such words as “group”, 
“type”, “class”, “classification”, “kind”, “sort”, and other expressioiis 
equivalent to these© 

9ol Criteida and Examples 

9.11 An instance (either a particular or subclass) is given, and the 
type (class, kind, etc.) which it belongs to is asked for© 

9.111 Is it (“there”) usually an adjective? 

9.112 What type of reaction is this: exothennic reav'^tion? 

9.113 What group (of animals) does the starfish belong to? 

9oHU Would this (NaOH) be an organic compound or Inorganic? 

10. Comparing and Contrasting 

Tiie most (though not entirely) dependable verbal earmark of these 
questions is the presence of such expr^®’ s as "difference between 
(in, among)", "differ”, "differ from”, Afferent” - "compare”, ”1*’ ”, 
“correspond”. 



o 
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10.1 Criteria and Examples 



lOoll Tt'To or more things are specified, and the dif feasances or 
similarities between them are to be supplied. 

10.111 I-^hat is the difference between organic and inorganic 

( /»nYtmnmnHfa ^ ? 

10.112 l#iat do the/ (words on board) Iiave in common? 

10.113 How does that (murder) differ from culpable homicide? 

10.111; Is there an/ difference in the tongue of the lizard 
and the salamander? 

10.3*2 Two or more objects are mentioned, and their differences or 
similarities with respect to a specified characteristic or 
a component part is required. 

10,121 Where do we have a big difference in these animals 
(frogs and salamanders)? 

10^122 Can jou t^l the difference between SO 2 and H 2 S as 
far as the odor is concerned? 

10.123 What is the difference in these two (axon and dendron) 
in their structure? 

10,13 object is specified, and something similar to or different 
‘om it is to be supplied, 

10. X 3 I ^^^t would it (nervous system) correspond to in a 

btiilding? 

10,132 liJhat*s the opposite of the word "dorsal”? 

lO.ll; Two or more things are supplied, and the entiy asks whether 
the things are alike, the same, etc, 

3-0,li;l Is the state the earns thing as the government? 

10,ll;2 Would a quail be something like a partridge? 

Conditional Inferring 

11.1 Criteria and Examples 

U«1X The antecedent gives an objective condition in which a person 
finds himself, and the question asks what comes to mind, how 
one would feel, etc, 

11. ni T#iat is the one wish that goes throu^ your mind (when 

you are in a situation that is utterly hopeless)? 






11.12 The antecedent mentions or suggests a psychological state 
(need^ T/rantf feeling^ use of mind or nenrous system, know^ 
perceive, etc.), and the question asks vhat is to be done, 
what has to be done, what is going to be done, what you would 
do, what the result would be, i^at would be possible, etc. - 

II9I21 If you need a modifier, to mcsiify a verb, which one 
(modifier) are yai going to take? 

: i 1^2 If you tried to stop thinking, couldn’t you? 

ii.123 If you saw it (cerebrum) from say, the back, ^diat would 
it appear to be like? 



H*13 The antecedent gives 3 condition, and the question uses such 
expressions as what nappens, what might happen, etc., to ask 
for the consequent. 

11.131 What happens when you are hypnotized? 

ll.lU Ihe antecedent gives 3 condition (action, decision, social 
practice, etc. ), and the question asks for an effect which 
is good, bad, negative; or the question may simply ask for 
a value judgment, as in (11,11^2) below, 

H.lld. kTiat are some bad things (which result to the colonies 
by colonization)? 

il.lii? Is he a good judge if he sentences the man to hanging? 

11.15 The antecedent gives a condition, and the question uses such 
expressions as "effect”, "affect", "influence", "result", 

"get", "gain", "give", "bring", to ask for the consequent. 

Unlike H.llf above, a descriptive rather than a value consequent 
is asked for. 

11.151 What else (did the mother country get from haying 
colonies)? 

11.152 Something else (which results to the colonies by 
colonization)? 

11.15 The antecedent gives a condition, and the question uses the 
expressional form »lVhat is x...?» to ask for the consequent. 

H*l*^l If they’re (two lines) parallel, xdiat d.s the altitude 
of the two triangles? 

11*162 What is the side of the square, if its diagonal ijs 10? 



11*17 The antecedent suggests an oparatioa (matheTnaticai. oh^/sleal, 
etCe}» and the qtiestlon spks for the result^ outcome^ ©tc* 

U*171 If you put gold in aqua regia* what becoirss of the 
gold? 

11.172 IrJhat vould result if we were to add this wejght-qy to 
the beam? 

U*l8 The antecedent gives a condition {mathematical^ physical^ etc*) 
and the question uses such expressions as **how much”, ”hoir 
long”n "how many", and other quantitative expressions to ask 
for the consequent* 

11*181 If you had a car and go fifty miles an hoar for three 
hours, well, how far do you go? 

11*182 If the base is CD, we knew its (parallelogram* s) here 
is how long? 

Uol9 The antecedent ^ves a conditiori, and the cemsequent asks how 
something may be Identified, e3q>lained, classified, defined, 
called, etc, 

11*191 If it (fish’s eye) is not compound, what kind is it? 

11*192 When we use this term (friction) in physics, how do we 
defins it? 

Ils20 The antecedent tells idiat an object or substance Is, and the 
question asks what it would do, etc* 

11*201 If it's an electzovalent conq^ound, then It would? 

EIxplaining 

Entries beginning with How«.*(,? and Why***? usually are expLanatlon 
entries* So, these steins are fairly reliahlo cues* Bub if these cues 
alone are used, maiy explanation entries will be overlodced* For some of 
them have quite different stems, such as What*,*? Is**.? Can*,,? and 
Would* ••? Bie following is a typical case of entries having such stems t 
•’/Jhat else happened that helped business?* The student is asked to cite 
the event that supposedly "helped business"* In genial, entries asking 
for evidence (laws, rules, facts) to account for something are clssslflpd 
under explanation* 
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12,11 Criteria and Examples 



12pHl 



A physical or biological deration or process performed 
tQT-r or occurrli^ in, sn ardmal (person) or plant is 



m rraT% 






V*4V«» 



or is perfonned^ 



o wiv o C7JU 4' liunr %JX~ 



why 



AS, 

JUU 



UUCUiT£5 



12.H11 How does a chicken digest its food? 

12«1112 is It that a trog can live under the 
water? 



12^112 The entxy suggesisa physical or biological outccne, 
result^ process, or operatiion that is prevented or 
kept as it is, and the entry asks what it is that 
prevents it, etc* 

12*U21 VJhat keeps the bodjy temperature from rising 
on a hot day? 



12o2 Causal Ei^aining 



2^0 21 Cril^Tia and Fjcan^les 



12^211 Ihe entry gives a psychological state or attitude 
(actual or claimed) of a person cp gipoup, and asks 
why it occua^s or i^at brings it about* 

12*2111 ^Jhy do you suppose the attitude of the 
President was against the Suez invasion? 

12*2112 T^hy was the main character often unhappy? 

12*^2 jjJie entiy suggests a possible cause of an act (or 
result), and asks how the suggested cause leads to 
•Kie givsii act or outcome. 

12*2121 How does sodo-econondc level lead a person 
to engage in delinquent activities? 

*2.213 The entry gives a social ot political c<siditlon or 

action, and asks how or why it occurs or has occurred, 
or what condition causes it* 

12*2131 1/ly did the Democratic party lose the 1952 
election? 

12,2132 ’What is the cause of ;fuvenlle dellnquen(y? 



12«2Il4 A physical effect or outcoine (organic or inorganic) 
is mentioned or described^ and the entxy asks idiy it 
occurs, or what produces it, or what amount of some** 
thing will produce it. 

I2^2 i)il wiw does i ron rust? 

12«211j.2 Why does a free flosting magnet point to 
the north? 

12«2l5 A state of affairs (organic or inorganic) is described 
and the entry asks or how it is the case. 

12. 21^1 is the yellow pine found in the deep 

south rather than farther north? 



12.3 Sequent Explaining 

12.31 Criteria and Examples 

12.311 ihe entry states something that happ>ened, and it 
asks how it happexnd. Usually the word ”happ»en” 
occui'S in the question and the question usual3y 
begins with "How". 

12.3X11 How did Cooiidge happjen to become president? 

12.3U2 How is it that Jadcson ^t the name of 
Stonewall? 

12.312 The entry describes a state of affairs, and asks 
what some person did that brought it about. These 
entries usually begin with **What". 

12.3121 What had Jackson done that turned the 

financial interests in the East against him? 

12.313 The entry suggests an outcome or result, and asks 
implicitly what events brought it about. These 
entries usually begin with "What" • 

12.3131 What turned the Chamber of Commerce against 
the NRA? 

12«31i( The entry states a particular thing that was dons 
hy a p)erson(s) oti^r than the one adcirassed, and 
asks how it was done. 

12.31i^ How did he (author of film) show those 
(ancient fish)? 

12o3lii.2 How did Lincoln succeed in winning the 
nomination? 
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12oii Procedural Explaining 

Cilteria and Examples 

12«Ull The entry asks hoy the person addressed does or did 
a particular thingo 

12.2(111 How do you extract it (pctaasium)? 

12.2(112 How*d you spell ”hydlroxide”? 

12^2(12 The entiy asks how the person addressed gets or got 
a particular result. 

12.2(121 Hcw*d you get the answer to that problem? 

12.2(122 How do you get that result on those scales? 

12.2^13 The entry asks how the person addressed (or another 
person or persons)" does cr did, can (could), or will 
(would) do a particular thing. 

12.2(131 How could you prove that the Pilgrims came 
here for religious freedom? 

12.2(132 How 's^rould you identi:^ an acid? 

12.2(133 How do they hybridisie com? 

12.2(l2( The entry asks how a particular something is done 
(without regard to tine, drcumstanee^ or person). 

12.2(12}1 How is sulphur mined? 

12.2(12(2 Humidity is measured in what wcy? 

12,2(31(3 *‘Grandiflora” is spelled in what way? 

12^^ Teleological iSxplaining 

12.^1 Criteria and Examples 

12.511 The entry asks why something is important. 

12.^111 is the ability to diange its color so 
important to the cr^meleon? 

12.^112 Can you tell us wl:^ rapid communication is 

lu^ortant to a nation with a large territory? 



12o$12 The entry asks how car why somsthing (exi^ludiiig 
linguistic and mathematical materials) is used* 

12*^21 Why is lead pipe used in plumbing? 

12o5l22 How do the various foundations use their 
money? 

12«513 ^he entry asks why certain structures (biologicaln. 
idiysicalf or social) exists or why they occur ox* 

Tfork in a particular way, 

12o5l31 Why are thez^e three branches in our government? 

12*5132 Why do frogs have wrinkled skins? 

12,5llt ?he entry asks why a person or group does (did) or 
vould do a particular somefhing* 

12o5litl Why would they (Boxers) pick on that 
particular city? 

12.51i^2 lifhy did he (Arthur Jarvis) leave it (his 
infiting)? 

12*5i5 The entry asks why a paxrtlcular situation is a 
problem. 

12*5lSl Why are traffic fatalities a problem? 

12.6 Normative Explaining 

12«6l Criteria and Examples 

12*611 The entry asks why so^mething is classified in a 
particular way, how it is identified, or why it 
is called what it is called, or it asks for a 
characteristic which is used to account for something 
being or becoming a member of a group* 

12*6111 Why do we call them (animals between 

vertebrates and invertebrates) the chordata 
anim^ group? 

12*6X12 Why do we put the gypsy moth under a. .^ets? 

12*6ol3 Hew do we identify splderwartd? 

12o612 The e;itry asks how we know something* 

12*6121 How do you know that sodium chliuride should 
react neutral? 

12*6122 How will you know whether to use the definite 
article here? 
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12o 613 The entry asks for reasons to justifjr a particular 

conclusion. The word ”r»ason” appears in the question. 

12.6131 For what reason (two sides equal)? 

12.6132 What do you have as the reason the two 
triangles are congruent? 

12.614 The entry asks why or how some particular linguistic 
usage is chosen, decided upon, accepted, etc. 

I2.6llil V?hy (do you think the modifier in the stmtence 
should be "positive")? 

12o6lhZ Why do you decide on "rapidly” (as a modifier 
in a sentence)? 

12.6lli3 How are yoa going to decide in this case 
which one (adjective or adverb) you use? 

12.615 The entry asks why a given conclusion (explicit or 
implicit) is the case. 

12.6151 Why does angle A equal angle B? 

12.6152 Why do you say that we can*t use that formula 
here? 

13 o Directing and Maneging dassjroom 
13.1 Criteria and Examples 

13.11 Tbie entry asks about reports, themes, and papers-*«»when they 
are to be made or corf5)leted, who is to do them, xdiat is the 
subject of reports, topics, etc. 

i 

13*111 Who wants to give a report on the fisheries? 

13-112 Let’s have your report? 

13.113 How about a report on rockets? 

13oHU Did you include the north star in ycur report? 

13.115 Do we have anybody who hasn’t had a chance to report? 

13.116 Would you read your theme? 

13.12 The entry asks about problems, topics, outlines and assignments. 
13.121 Was this topic in the assi^ment? 

13*122 Are we supposed to continue with these questions? 

13*123 Didn’t I assign those problems? 

I3.12U Were we to write the assignment out? 



13ol3 The entiy asks about \jho hadj or who is to do a prob3.emj> 
or it invites someone to handle a problem in eiass^ etc* 

13*131 has problem Np« U? 

13*132 The sixth one (problem in gecanetiy)? 

13*133 The next one (problem in physics)? 

13*13U Give us that one (problem)* 

13*135 Number U, please* 

13*li^ The ^tzy asks about classroom meehanic8««who Is to lead 
discussion^ etc* 

13*lUl Who is to lead the groi^ today? 

13*lli2 Who is to pass out the books today? 

13*15 The entiy asks about answers to questions«*rating of examinationSj, 
giving of examinations^ etc* 

13«151 Is the test worth 100 points? 

13*152 Hew much did you take off? 

13*153 What was question 15? 

3* Reliability of Criteria 

The type of reliability estimate we used to determine the reliability 
of the criteria was one based on percentage of agreement between independent 
judges* The experiiisnbal phase involved obtaining independent judgments of 
a sample of entries* The statistical index that we used was a rather simple 
one involving merely frequencies of agreements and disagreements w 

Four judges were used to obtain the independent judgnents required for 
the reliability test* These four judges were graduate students in Education 
at the University of Illinois* Two mre from the educational psychology 
program and two were from the philosophy of education program. 
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Tifo sample sets of entries were used for the purpose of training the 
judges. The first was an easy set containing about 5^ entries. The other 
set was more diffiailt and contained about 120 entries. 

Before claasifSring the first set of entries., the iudees irerA cfl'wfiTi crftnftr**! 
instructions and a set of general procedures to be followed in classifying 
the entries. These general p3?ocedures are to be found in the Appendix. 

After classifying the first set of easy entries independently of each 
other, the judges met with us to <^eck their agreement and to discuss difficulties 
they encountered. They then classified the second set of more difficult 
entries and afterwards met i^jith us again to check their agreement and discuss 
their problems. 

The final set of about 300 entries was then classified by the judges. 

The entries in this final set were selected randomly from the aitries we 
judged to be in each category. One out of four entries in all but one of 
the main categories and the subcategories of Designating were selected randomly, 
and one out of three entries in the subcategories of Defining and ISxplaining 
were selected randomly. The one exception was Substituting, which had so 
few entries that we used tl^m all in the final set. 

The agreement on this final set of entries was determined for two oairs 
of judges (each pair containing one philosophy student and ons psychology 
student). This latter procedure was used to ndniinize the number of sheer 
oversights likely to occur— rather than actual mis judgments and misapplications 
of the criteria. Thus these reliability estimates are for pairs of judges, 
not single judges, (We feel it best that judges always work in pairs rather 
ttian singly on this material, because its complexity tends to result in many 
” sheer oversights’*©) 
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TJie statistical index used to estimate the reliability of the logical 



categories was based upon the number of agreements per category between -^le 
two pairs of judges® Thus each category has a separate coefficient® 



j.ne xvrxauxa lur oaXs 



XS5 Hi « Ai ^ where is the 



estimated reliability for categoiy (or subcategory) i, Ai is the number of 
agreements in category i, Dii is the number of entries placed in category i 
by the first pair of judges but not by the second pair, and Tiz± Is number 
of entiles placed in category i by the second pair of judges but not by the 
first. The estimated reliabilities we obtained are presonted in Table 6:1^ 

ft 

('The entries designated IT, 3T, and 1?T are for these categories as a who3.e, 
i.e. ignoring the subcategory divisims,.) 

As can be.seen^ the estimated reliabilities range from O.OO to 1»00. 

The median is ,67, and the middle of the estimates rai^e from .62 to 
a fairly hi^ percentage of agreement for the present status of our 
categories® 

The highest estimated reliabilities are those for categories 3ftl$, 3 .Hi, 
loll, lil2, and 6*^two subcategories eadi in Designating and Defining, 
respectively, and Substituting— j these range from .88 to 1.00. The lowest 
estimates are those for categories I.II4, 1.13, 5, and 12.3— two subcategories 
of Defining, Reporting, and an l&plaining subcategoiy— j these range from 
0.00 to .36. (The two subcstegories l.lU and 1.13 in Definirig had only two 
entries each, so that the very low estimates for these subcategories—o33 
and 0.00, respect! vslyft*»are undoubtedly due at least in part to sampling 
error. ) 
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Table 6:1* Reliability estljuates for the criteria 
for the logical categories ♦ 





Reliability 


Cr3tegory 


estimate 


1,11 


.88 


1,12 


.88 


1.13 


.33 


1.14 


0.00 


IT 


.8U 


2 


.67 


3.11 


.6U 


3.12 


.62 


3.13 


48 


3.1U 


.90 


3.15 


1.00 


3T 


.71 


h 


.63 


5 


.33 


6 


,88 


7 


.60 


8 


.73 


9 


.70 


10 


.62 


11 


.67 


12.1 


.83 


12.2 


.55 


12.5 


.36 


12.U 


.67 


12.5 


.67 


12,6 


.76 


12T 


.8U 


13 


.87 
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These estimates are shown graphically in Figure 6?1, (Here, e*g*p the 

I 

concentration of the middle estimates is mere apparent «) 



Figure 6sl Frequency distribution of reliability estteates. 




li. Discussion and Interpretation 

On the basis of the work we have done the catego? .es, it seems 
apparent that much of the unreliability is die to four somewhat distinct 
types of difficulties. 

One type is overlapping between the categories due to the presence of 
conflicting cues within the entry, i,e, one part of the entry indicates that 
it is to be placed x4.thin ons category and another part of the entry indicates 
that it is to be placed in an entirely different category. In this type of 
difficulty, the two separate parts of the entry each by themselves clearly 
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coofcTn to ths crlt6Pl3 but ccnllllcl/ as to 'whlcb catogojy tho entiy is to 
b© Xocatoi* Thus disagroomant nia 3 r rosult iTrom on© judge following caae cue 
and aix)ther judge following tbe other cue. 

In the second tvne of no44-.vtaw 4>.Ka 

W * ^ VMTW W**«W JUVA 

Significant part of the entijr seems to satisiy the criteria of aqy category. 

That is to say> the entry does nob seem to belong in any category. Judges 
will disagree as to which of several categories seems to be the most appropriate. 
The third type of difficulty is sonewhat similar to the first type. 

It is due to what seems to be a gradual shading of one category into another^ 
e«g «9 Designating teiKis to shade into Bbcplanation^ the entries seeming to 
fall along a continuum. Here judges may differ with respect to the poii^ 
on the "conbimum” at which th^ separate one category from the other. 

The fourth type of difficulty arises from the fact that our criteria 
involve varying levels of inference^ some being extremely hi^ in referential 
distance from the categories and others very low, Ihe criteria for categories 
3«15» 1*11, and 1,12 require very little inference. These eases^ as already 
noted, are among the categories high in reliability. It is interesting to 
note that ^<:^>th verbal and syntactical cues are strong and dependable in the 
criteria for these categories. The verbal cues "mean” and "define" as well 
as the syntactical cue *Khat is X?’ go a long way toward indicating unambiguously 
the category to which entries exhibiting them belong. On the other hand, 
some categories are marked by criteria requiring a great amount of inference, 

A case in point is category 12,2 - Causal ’plaining. The criteria in this 
case are not only vague but they also require the judge to decide whether 
an entry asks for an explanation of an event, or an explanation of an 
explanation of an event. Such an int^pretation of a criterion, to say the 
least, involves a high order of reasoning, especially when neither verbal 
nor syntactical cues are dependable o 
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At present, have been unable to develop eithai- completely independent 
categories or miitable criteria by which to eliminate su* difficulties, and 

it is often not aear as to jdiether it is the categories or the criteria 
Which needs the most impzrovenent. 
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Bsis ch£g>ter viil present the results we have obtained iq) to this point 
with the lx)gioaI categories. We will first treat the actual exi.stence aacl 
relative frequen<^ of logical operations in the teaching we saag>led, and 
then discuss hriefl^y" diff^^nt^s in the cccturr^iee of these categories aiaong 
schools, grade levels, and content ai*eas— Mathemtics, Science, Social Studies, 
English, and Core Program* 

We would nice to emphasise that our analysis at this point is of the 
sheer frequency of the logical denends^Has th^ appear in tins entriesowaade 
xBOstly hy the teachers on the students. We have not as yet analysed the 
sequences or patterns of these dcsands, nor the ways in which these 
are handled within the bodies of the episodes. 

1* !She Eidstence of logical Operations in {Reaching 

Toe purpose of the first phase of our investigation, as indicated in the 
first ch^ter, is to determine logical 3?attems, If ary, are to be ftound 
in teaching. ®iu«, as we discussed in OiapterXi;, ve sampled classes in various 
content areas at different grade levels, and in schools having vari.ou8 spending 
patterns, sociocultural environments, and teachers of aomeid»t dHTerent 
training and ba<dcground in handling logical natters. We feel that we obtained 
a fairly r^resentatlve sasple of teaching, bat eerbainly do not we 

have a random sasple of teaching«*vhatever such a procedure might in the 
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context of teachingo the reader will recall that* we essentially had 

to use teachers who ‘volunteered their services*) 

All the entries in the classes that we taped and were able to use were 
classified by the two members of the project staff (the principal investigators) 
who were responsible for developing the categories* Eadi entry was placed 
in one and only one category— no disagreemonts were permitted* 

The di8‘tribution of entries by the logical categories obtained by this 
procedure is presented in Table 7sl« The classes have been grouped by subject 
matter and content area* 

It is clear from examining Table 7*1 that several distinct types of 
logical operations are present in the teaching we have analyzed* !Rie entries 
clearly are distributed among all the categories— though by no means equally— 
and there are large numbers of entries in each of what we know to be logically 
distinct kinds of operations^ especially in the categories of Sescrlbingf 
Designating, Fbcplaining, Conditional Inferring, Defining, and Classifying* 

(We know also from the reliability test reported in Chapter VI that discriminations 
can be made among ‘these categories fairly consistently.) 

Not only do we have clearly different logical operations in the teaching 
we have studied, but these logical operations differ in the frequency with 
which they occur* There is no clearly appropriate vethod for obtaining expected 
frequencies in each of the categories from our data, nor do we have any defensible 
rational basis for determining the expected frequencies in each category; 
therefore we have not employed a significance test to establish that these 
Categories vaxy in frequency of occurrence. However, it is dear that with 
such a large number of entries no statistical test is required to support 
the condusion ‘that the number of entries varies significantly from one category 
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^ibld 7$X» ])i 0 fsrltmtl«a of Logtctl ^Ktocsorl^ fixma wed aftjeets* 
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ta 

a 

•H 

gL 

, t 


«r 


i 1* 
s 

. 1 


a 

1 


n 

t 

% 

n 

* 

to 


a 

CO 
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1 

3 

1 
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1 


1* Def!3>ning 
1.11 


5 


2 


3 


7 


U 


2 


2 


0 


10 


6 


1.12 


h 


1 


2 


4 


14 


4 


0 


0 


7 


1 


1.33 


0 


0 


0 


0 


0 


2 


4 


0 


0 


0 


i.ik 


0 


10 


2 


0 


1 


i 


0 


0 


0 


0 


IT* 


9 


13 


7 


11 


26 


9 


6 


0 


17 


7 


2o Describing 


97 


63 


59 


no 


62 


39 


82 


33 


49 


35 


3« Designatijog 
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1 


0 
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11 


2 


2 


0 


1 


12 


3.12 


4 


1 


1 


7 


6 


1 


.4 


0 


2 


0 


3*13 


29 


7 


U 


28 


27 


6 


4 


1 


4 


6 


3.14 


0 


0 


0 


0 


14 


13 


40 


8 


42 


3 


3*15 


2 


2 


\J 


13 


6 


1 


4 


0 


5 


2 


3T* 


36 


10 


20 


65 


64 


23 


54 


9 


54 


23 


4. Stating 


58 


12 


7 


5 


5 


10 


16 


2 


4 


4 


3* Berporting 


6 


7 


0 


9 


14 


5 


6 


0 


9 


33 


6. Substituting 


4 


4 


0 


0 


0 


0 


0 


0 


0 


2 


7* VaSxntting 


2 


4 


13 


1 -1 


4 


23 


4 


2 


17 


7 


8* Opining 


6 


1 


5 


i 3 


12 


43 


27 


6 


5 


6 


9* Glasslfyisg 


U 


2 


6 


i 20 


2 


2 


4 


1 


2 


2 


10. Ooniparii^ and 


contrasting 


11 


8 


5 


i 23 


7 


7 


6 


3 


6 


5 


11. Conditional 


Inferring 


37 


26 


15 22 


19 


12 


9 


2 


25 


16 


12 . StQplalMng 


12.1 Mechanical 


0 


1 


0 


> 12 


6 


0 


0 


0 


0 


0 


12.2 Causal 


0 


6 


8 U 


14 


18 


7 


3 


12 


9 


12.3 Sequent 


0 


0 


0 


5 


0 


9 


17 


0 


4 


2 


12.4 Procedural 


16 


3 


30 


4 


4 


0 


4 


0 


4 


1 


12o5 Teleological 


2 


0 


2 


! 4 


5 


12 


6 


4 


4 


4 


12.6 Ifoimative 


22 


0 


6 


I XL 


1 


8 


2 


0 


2 


4 


12 T* 


2|0 


30 


^ 47 


P 


47 


36 


7 


26 


a) 


13 . Directing and 


Managing Classroom 




6 


17 


12 


15 




7 


8 


29 


9 


Total number of entries 


per subject 


356 


166 


100 


388 


260 


8 $ 


257 


53 


8 b 3 
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^%i5icates^£btal number of entries in this category* 

#Suib8cripta on the subjects in this area indicate the school in idkich this class vas 



taped< 



er|c 



Tilm o QpgtjLnaed 






Category 





lo Defining 
X*H 


U 


4 


6 


0 


69 


2.0 


1.12 


I 


0 


6 * 


0 


44 


1*3 


1.13 


1 


0 


3 


0 


10 


0.3 


1.14 


0 


1 


0 


1 


16 


0.5 




13 


5 


15 


1 


239 


4it 


2. Describiiig 




4o 


96 


77 


861 


25.3 


3* Designating 


3^U 


15 


Z 


c 


0 


71 


2.1 


3*12 


T 


1 


0 


0 


34 


XeO 


3.13 


38 


8 


9 


14 


192 


5.7 


3.14 


2 


16 


8 


4 


150 


4.4 


3.15 


6 


10 


3 


3 


57 


1.7 


3®* 


68 


37 


20 


21 


504 


14.8 


hm Stating 


94 


2 


7 


4 


230 


6.8 


Itepoztlng 


6 


0 


6 


Id 


99 


2.9 


6m Substituting 


0 


0 


0 


0 


10 


0.3 


7. Veluatlng 


T 


If 


44 


9 


156 


4.6 


8» Opining 


3 


11 


37 


12 


179 


5.3 


9. Classifying 


a 


12 


n 


7 


103 


3.0 


10. Comparing and 


Contrasting 


8 


10 


11 


2 


112 


3.3 


11« Conditional 


Inferring 


9 


17 


24 


15 


248 


7.3 


12. E}{plaining 


12.1 Mechanical 


0 


0 


1 


1 


21 


0.6 


12.2 Causal 


4 


2 


17 


3 


114 


3.4 


12.3 Sequent 


2 


6 


4 


0 


49 


1.4 


12.4 Procedural 


4 


3 


4 


5 


62 


1.8 


12*^ !?eleologlcal 


4 


6 


21 


5 


79 


2.3 


12.6 Iformative 


44 


4 


8 


1 


113 


3.3 


ISS» 


58 


21 


55 


15 


438 


12.9 


13. Directing and 


Managing dassroom 


38 


18 


22 


49 


318 


9.4 


Sotal number of entries 


per subject 


364 


19Z 


348 


230 


3^7 





'^b^ca^s iotal number of entries In this category* 

/Subscripts on tbe subjects in tMs area indicate the grade level of thie eXass. 
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to another o Describing, Designating (3T), and Explainii:g (12T) are the three 
most frequently occurring operations in that order, with Directing and Managing 
Classroom and Conditional Inferring and Stating next. The least prevalent 
operations--aeide from the subeategorios— seem to be Substitutine- Renortincr* 
and Classifying. 

We conclude, then, that we have established clearly that there are logical 
operations in teaching, and furthermore that some of these operations are 
significantly more prevalent than others, notably those of Describing, Designating, 
and Ejcplaining, in that order. 

2. Logical 0perat5.ons Within and Among Content Areas 

As we examined the resul,ts we obtained, as shown in Table 7 •!, we observed 
marked differences from class to class in the frequencies of the logical 
operations. Although the analysis and interpretation of sudi differences is 
not central to our project, and certainly was not included in the original 
purposes indicated above, we felt that some discussion of these differences 
might be of interest. 

Since our data were not gathered for the puipose of clarifyii^ the 
relative effecT.8 (on the nature and frequency of logical operations) of 
teachers, subjects, schools, and grade levels, these variables are highly 
confounded. 

The schools differed with respect to money expenditure per student and 
sociociiltural characteristics. Such differences would probably influence 
the logical demands in the classroom mostly throu^ the medium of the teacher, 
so that school differences probably reduce to differences in teachers, ®ius, 
for the purposes of this dlscuSw^ion, we can ignore differences between the 



schools 
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ife taped classes varying from the ninth to the twelfth grades. This 
variation in grade level, hwever, occurs in an age range in which the capacity 
of the average student to handle logical demands is probably the same from 
one age ievsl to another. On the basis of a great deal of evidence concerning 
lAe dev^opment of IQ with maturation, it seeims fairly clear that there is 
little significant increase in the IQ beyond the ninth grade} thus the capacity 
of the student to handle intellectual operations probably changes very little 
dux'ing the hi^ school years. Also, Piaget's observations have led him to 
conclude that the handling of propositional logic has been achieved by most 
ncpmal adolescents by the time they have reached ht^ school. Thus, for tine 
purposes of this discussion, we can ignore next only the differences in schools 
but the differences in grade levels in so far as maturation of the student 
ie a factor in determining the logical operations at these levels. 

However, these assumptions still leave the teacher and subject matter 
variables confounded. It is unrealistic to assume that either of these 
variables has little or no effect on the distribution of logical operations. 

It seems qalte plausible to expect tliat teachers will differ in the extent to 
which they employ different logical operations in the subject taught. On this 
matter we can cite relevant evidence from our own tapes, "Ie have two U,S, 
History classes at the eleventh-grade level that dealt with fairly similar 
historical periods (labeled in Table 7 j 1 as Hlstozyg and H,S. Histoiyg), 

In the U,So History^ class, there are fewer entzies especially in Describing, 
the 3olli subcategory of Designating, and Saquent Explaining, but there are 
more entries in Valuating, Opining, Causal Explaining, and Directing and 
Managing Classroom, These differences seem to be attributable to the teachers' 
ways of handling the material, rattier than to differences in the subject matter. 
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It is slso quite plausible that there are differences fipom subject to 
subject within a content area (sog*, PhQraics vso Biology in the Science area), 
and from one content area to another, Althou^ we realise that the teacher 
and subject variables are confounded, we shall summarize vtint seem to be the 
main differences between the classes within and between the content areaSo 
These should indicate to some extent (and to what extent cannot be determined 
from our data) differences among the subjects and areas with xespect to the 
frequency with ^ich the various logical operations occur, 

^fferences within the areas . Within both the Mathematics and Core 
Program areas there is only one subject, thus permitting no comparisons within 
these areas, 

(1) Science , 'ithin the Science area. Physiology seems more concerned 
with Defining (1,12) and Designating (3»13) than the other subjects; Physics 
is concerned more with the use of qymbols (l,li 4 ) and Condtttional Inferrir^; 
Biology and Chendstxy seem to deal mor-e with Valuating matters (correctness 
of evidence, correct answers to problems, etc,) than Physics and Physiology, 

It is interesting also to note that little difference between the subjects 
appears in three of the Explaiitog subcategories (Causal, Sequent, and 
Teleological); differences do seem to appear in Mechanicad Explaining— where 
Biology is especially high; in Procedural Explaining— where Chemistry is high; 
and in Normative Explaining— where Biology is especially high, probably because 
of its concern for justifyirig classifications, 

(2) Social Studies , In the Social Studies, Sociology is somewhat high 
in 3,11, but is low in 3*ll4, as is IJ,S, lUstorygo On the other hand, U,S, 
Historyjg is high on 3*lU, as is World History, U,S, History^ seems quite 
high on Opining, but World History is low in this category, (U,S, History^ 



7«8 



is also very hi^ on Directing and Managing C3.assroora-«*this is probably due 
t.o the student-centered characteristics of this class.) World History and Sociology 
are slightly hi^ on Conditional Inferringi D.S, History is somewhat low in 
this category. 

(3) English . In the En^ish courses that we taped^ the ninth-grade class 
seemed to be mainly concsmed at the time with the learning and application 
of rules of gramarg whereas the eleventh* and twelfth*grade courses were 
oeeapled at the time with topics in literature^ involving discussions of novels, 
etc. Ihese content differences were reflected in the distribution of entries 
in the logieid categories. The concern with the statement and justification 
of the use of grammatical rules resulted in many entries in the Statii* category 
and normative Explaining subcategory, whereas the discussion of characters 
and issues in the novels resulted In man> entries especial3.y in the Opining 
and Valuating categories. 

Diffepsj^^s among areas . Table 7:2 contains the number of entries in 
each category organised by the area. The main differences among the areas 
seem to appear in Stating, two Designating subcategories (3*13# 3*lU), two 
Explaining subcategories (Mechanical and Normative), Directing and Henaging 
ClassTocm, Opining, and Yaluatlng. In these categories. Science is especially 
low in Stating, 3«lU (a Designating mVOcategory), Normative Explaining, Opining, 
Valuating, and Directing and Managing Classroom^ it is hi^ in Tfechanical 
Explaining and 3*13 (a Designating subeategory). The pattern for the Social 
Studies area is exactly the reverse of Scionce except for Normative Explalni!:ig 
(where both ar^cs are lev). Both Mathematics and English are hi^ in Stating 
and Normative Explaining, whereas English is high and Ms^.ematios Xov in 
Opining and Valuating. 
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ItB* l>l8ti^lbu.tion of logi c al CSategoid^M ligr Areas* 
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rt 
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a«ito 
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1.X2 


fSL 


12 
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0 


4b 


1.3 


1.13 


0 


0 


6 


b 


0 


10 
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1.14 


0 


13 


1 


I 


1 


16 


0.5 




9 


5T 


39 


^3 


1 


139 


b«i 

f 


2* Describing 
3* Designating 


97 


sgk 


a8 


175 


77 


661 


25.3 


3*11 


1 


36 


17 


17 


0 


71 


2*1 


3.1S 


4 


15 


7 


8 


0 


3b 


1.0 


3.13 


29 


73 


a 


55 


Ib 


192 


5*7 


3.14 


0 


lb 


id6 


26 


b 


1^ 


b.4 


3.15 


2 


a 


12 


19 


3 


57 


1.7 


3*» 


36 


1» 


163 


11^ 


a 


50 b 


lb.8 


k* Stating 


58 


29 


36 


103 


b 


230 


6.8 


Se^rting 


6 


30 


33 


12 


18 


99 


2.9 


6. Substituting 


4 


k 


2 


0 


0 


10 


0.3 


7« Valmting 


2 


22 


53 


70 


9 


136 


b.6 


8. Opining 


6 


a 


89 


91 


12 


179 


5.3 


9. dassifl^ng 


11 


30 


11 


bb 


7 


103 


3.0 


jU>. OoD^paring em 


Contrasting 


11 


43 


27 


29 


2 


112 


3.3 


11. Oonlitional 


Inferring 


37 




6b 


50 


15 
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0 


19 


0 


1 


1 


a 


0.6 


causal 


0 


39 


h9 


23 


3 


ub 


3.b 


1S.3 Seguent 


16 


5 


32 


12 


0 


49 


1.4 


12^4 Procedural 


2 


a 


9 


11 


5 


62 


1.8 


12*^ geleolQgioal 


22 


u 


30 


31 


5 


79 


2.3 


12.6 Ronoative 


ho 


18 


16 


56 


1 


113 


3.3 
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39 




136 
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15 


b38 


12.9 


13* Directing and 
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50 
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78 


k9 
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In Vbia es.tegpiT'. 


90 b 
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We mqy conclude tentatively f row this brief discussion, then, that It 
seems likely that differences may exist in the extent to which the logical 
operations are employed from teacher to teacher, and f rcm area to area© 

Adequate answers as to what this extent is, however, cannot be determinad 

from our data, but await f>irther studies designed more specifically to investigate 
these matters. 
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Procedures for CXassii^x;- 2 g Entries 



1. Befinitioas; 

Entries are utterances iMcIit^ser classroom discixssion. 2hey are 
usiial ly questions;, thougii laassy entjfies are dec3-arative statements, cosssands, 
invitations^ etco ‘The question- type entries vary in fom. Seme are straight 
interrogations* Others are incGE^plete, compietion, and rhetorieal-tyj^^e 
questions. 

2. Working Procedures: 

It is suggested that the folloTTicg steps be taken in ciassif^ng entries « 
Items in Step B nay be taken concurrentiy rather than in the order listed* 

A. Study the categories and criteria until you have acquired a -sorking 
knowledge of them. 

B. Hrstp isake a rapid end rough distribution of the entries by main 
categories, givi? 2 g no attention at this point to the riub-eategorieso 
let the refining process come later. The following hints asy be helpful 

1) Put all Sow.,*? and entries in an tolaining pile* A 

few of these questions ifiil not belong here, but they can be 
identified later. 

2) Sort all entries containing the words "define”^ ”mean"^ "meaning", 
into the Defining pile. Questions of the form ^I-Jhat is TV belong 
hers also. 

3) Entries containing such words as "type”, "class", "group", "kind", 
"sorb", shou3.d be thi'owa into the Classifying group. Ifot all of 
these belong here, but they can be sorted out later. 

k) Questions using the "differ", "difference", "compare", 

"corre^ond", "same", and comparable woxds sliould be put into 



the Gcmipailng-Coiitrast^ng groiq). 
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5) Enfcries a'bout fozroulas ^ould be put ioto tbe Sfcatiug group. 

6) All entiries using such terms as “right”, “good", "justice”, and 
other similar words should be placed in the Valuating category. 

Some of these may not belong here, but they can be sorted out 

later. 

7) Put all entries about assignments, examinations, classroom 
opsiation, and the like in the liscaging Classroom category. 

8) AH entries beginning with “If...” should be placed in the 
Conditional Inferring group. Some of these will belong in Idle 
Ifenaging Classroom group and can be placed there later. 

9) Itatries involving rise of such words as "example", “instance", 
etc. should be placed in the Designating category. 

iO) You now have a residual group of entries consisting largely of 
those which make up the Bescidbing, Designating, Heporting, and 
Stating categories. 

Cc You are now ready to begin the refining process. Consider the entries, 

one by one, in each of these roughly classified piles. As you examine 

an entry carefully, decide which of the subclasses of the main 

categoiy it belongs to. If it obviously belongs to none of the 

subclasses, it should be thrown i»’'*-o a residual group unless it 

occurs to you to place it in another category* In tliis phase of the 

work, it is especially important that you review the categories, 

criteria, ana examples from time to time, especially at points whore 

the classification of an entry is proving difficult* 

D. After you have worked throu^ all main categories, piecing entries into 

their subclasses, classify ell entri'*s in your residual group* ©xere 

is no laiscellaaeous categoiy* All entries must be placed into one or 
another of the categories provided. 
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3o Procedural Rules: 

a» 35ie CXassrocan i&nsgesient category takes precedence over all other 

categories, ^r €5^iiiplei> If ♦ . .then. . . ? srrbries sndBo¥. and VJlQr,*.? 
entries if^ch have to do ■with the nacageinent and cTperation of the 
classro<sn aire to be put into the ifenaging Ciassrocsa category^ even 
though their form indicates that they should be placed in Conditional 
Inferring and Explaining groips. 

b. Bcc^t for the Ifenaging Classioosn categojy^ c-he Conditional Iiaferriag 
category takes precedence over all other cate^^^ries. Sat3?ies idiich 
require definitions, explanations, value jixagiaients, or i-rhat-not should 
be placed under Ctonditional Inferring when they con’tain a statement 
of conditions. Sometiaies the conditions are in the last part of a 
sentence rather than in the first, for essaple, *Bbw do ve s^Jjaln 
eomerce, if we must describe the class it belongs to?’ !Ehe entry 
asks for an explanation. But the eosditicuial clause places it in 

the Conditional Inferring categor^jr* 

c. Ordinarily such expressions as "Do ycnx rancher”, "Can you naiae", 

”Do you knov?’*, and "Will you” are to be interpreted as stylistic 
elements in entries lather than as isubstantl-ye elements. However, 
this id not almys the case. A criterion for classifying an entry 
may have reference to the person addressed by the entry, for exaiaple, 
’Did you e'ver handle snakes?* In this case the expression ”Md you” 
is a substantive part of the. question. This my also be the case 
when the entiy asks for au opinion, for example, ’How do you think 
the Rcxnans felt about foreign conquests?* Thex^e is no general rrle 

for tolling when these expressions are stylistic or subs'bantj.ve. You 
' .11 have to depend upor intuition and your sense of context. 



